May 13 01:59:41.975360 np0000000663 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:41: EventletDeprecationWarning:
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: we strongly recommend against using it for new projects.
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: If you are already using Eventlet, we recommend migrating to a different
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: framework.  For more detail see
May 13 01:59:42.255474 np0000000663 nova-compute[98103]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 01:59:42.255474 np0000000663 nova-compute[98103]:   import eventlet
May 13 01:59:43.687933 np0000000663 nova-compute[98103]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=98103) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 01:59:43.687933 np0000000663 nova-compute[98103]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98103) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 01:59:43.688392 np0000000663 nova-compute[98103]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98103) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:44}}
May 13 01:59:43.688392 np0000000663 nova-compute[98103]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
May 13 01:59:43.822421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 01:59:43.833341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.011s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 01:59:43.883719 np0000000663 nova-compute[98103]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 13 01:59:44.782759 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 13 01:59:44.783023 np0000000663 nova-compute[98103]: INFO nova.utils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] The long task thread pool MainProcess.long_task is initialized
May 13 01:59:44.783233 np0000000663 nova-compute[98103]: INFO nova.virt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 13 01:59:44.887018 np0000000663 nova-compute[98103]: INFO nova.compute.provider_config [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 13 01:59:45.389172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Acquiring lock "singleton_lock" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 01:59:45.389322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Acquired lock "singleton_lock" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 01:59:45.389581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Releasing lock "singleton_lock" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 01:59:45.389801 np0000000663 nova-compute[98103]: WARNING oslo_service.backend._threading.service [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] no_fork=True: running service in main process
May 13 01:59:45.390174 np0000000663 nova-compute[98103]: INFO nova.service [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Starting compute node (version 33.1.0)
May 13 01:59:45.893322 np0000000663 nova-compute[98103]: INFO nova.utils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] The default thread pool MainProcess.default is initialized
May 13 01:59:45.893887 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 01:59:45.894448 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Starting event thread {{(pid=98103) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 13 01:59:45.894853 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Starting connection event dispatch thread {{(pid=98103) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 13 01:59:45.895486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Connecting to libvirt: qemu:///system {{(pid=98103) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 13 01:59:46.701229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x705c89f3fa10> {{(pid=98103) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 13 01:59:46.702112 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x705c89f3fa10> {{(pid=98103) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 13 01:59:46.703452 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Connection event '1' reason 'None'
May 13 01:59:47.206977 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Cannot update service status on host "np0000000663" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000663 could not be found.
May 13 01:59:47.207486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.mount [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Initialising _HostMountState generation 0 {{(pid=98103) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 13 01:59:57.187988 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host capabilities <capabilities>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:   <host>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     <uuid>275aca93-7ffc-4ab6-ac4d-09848357451e</uuid>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     <cpu>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <arch>x86_64</arch>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <model>EPYC-Milan</model>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <microcode version='16777317'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <signature family='25' model='1' stepping='1'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <maxphysaddr mode='emulate' bits='40'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='x2apic'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='tsc-deadline'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='osxsave'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='hypervisor'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='tsc_adjust'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='ospke'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='vaes'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='vpclmulqdq'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='spec-ctrl'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='stibp'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='arch-capabilities'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='ssbd'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='cmp_legacy'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='topoext'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='stibp-always-on'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='virt-ssbd'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='amd-psfd'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='lbrv'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='tsc-scale'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='vmcb-clean'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='flushbyasid'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='pause-filter'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='pfthreshold'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='v-vmsave-vmload'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='vgif'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='no-nested-data-bp'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='lfence-always-serializing'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='null-sel-clr-base'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='rdctl-no'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='skip-l1dfl-vmentry'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='mds-no'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='pschange-mc-no'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <feature name='gds-no'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <pages unit='KiB' size='4'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <pages unit='KiB' size='2048'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <pages unit='KiB' size='1048576'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     </cpu>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     <power_management/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     <iommu support='no'/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     <migration_features>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <live/>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       <uri_transports>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:         <uri_transport>tcp</uri_transport>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:         <uri_transport>rdma</uri_transport>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:       </uri_transports>
May 13 01:59:57.187988 np0000000663 nova-compute[98103]:     </migration_features>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:     <topology>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <cells num='1'>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:         <cell id='0'>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <memory unit='KiB'>24607188</memory>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <pages unit='KiB' size='4'>6151797</pages>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <pages unit='KiB' size='2048'>0</pages>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <pages unit='KiB' size='1048576'>0</pages>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <distances>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <sibling id='0' value='10'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           </distances>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           <cpus num='12'>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:           </cpus>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:         </cell>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       </cells>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:     </topology>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:     <cache>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 13 01:59:57.189545 np0000000663 nova-compute[98103]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     </cache>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <secmodel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <model>apparmor</model>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <doi>0</doi>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     </secmodel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <secmodel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <model>dac</model>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <doi>0</doi>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     </secmodel>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:   </host>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <arch name='alpha'>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>clipper</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:     <arch name='armv6l'>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>borzoi</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>spitz</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>nuri</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-b1</machine>
May 13 01:59:57.190321 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatileab</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>kzm</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-a</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>smdkc210</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>z2</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tosa</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>sabrelite</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-eb</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n810</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n800</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 01:59:57.191577 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatilepb</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>terrier</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mainstone</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>integratorcp</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>midway</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>musicpal</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>microbit</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='3'>fby35</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cubieboard</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>verdex</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>bpim2u</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduino2</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>raspi2b</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cheetah</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 01:59:57.192437 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>highbank</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>akita</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>connex</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>collie</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi0</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:     <arch name='armv7l'>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>borzoi</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>spitz</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>nuri</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-b1</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatileab</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>kzm</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-a</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 01:59:57.193260 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>smdkc210</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>z2</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tosa</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>sabrelite</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-eb</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n810</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n800</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatilepb</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>terrier</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mainstone</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>integratorcp</machine>
May 13 01:59:57.194020 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>midway</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>musicpal</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>microbit</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='3'>fby35</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cubieboard</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>verdex</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>bpim2u</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduino2</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>raspi2b</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cheetah</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>highbank</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>akita</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>connex</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>collie</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi0</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 01:59:57.194682 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:     <arch name='aarch64'>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.2</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mori-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>ast2600-evb</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>borzoi</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>spitz</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.7</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>nuri</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>romulus-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.0</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.0</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>npcm750-evb</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.10</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>rainier-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps3-an547</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.8</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-b1</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatileab</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>kzm</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fby35-bmc</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>musca-a</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-3.1</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.1</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>smdkc210</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.11</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>imx25-pdk</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.9</machine>
May 13 01:59:57.195636 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>orangepi-pc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>z2</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-5.2</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>tosa</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an500</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.12</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps2-an521</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>sabrelite</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an511</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>canon-a1100</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-eb</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>sbsa-ref</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.0</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.0</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi1ap</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sx1-v1</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n810</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g220a-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>n800</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.1</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.1</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>quanta-gsj</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>versatilepb</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>terrier</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mainstone</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>integratorcp</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-7.2</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-4.2</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 13 01:59:57.196438 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>mps3-an524</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>kudo-bmc</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a9</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>midway</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>musicpal</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s811evb</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>microbit</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='3'>fby35</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an505</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an385</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.0</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.0</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>raspi3ap</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cubieboard</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast1030-evb</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>verdex</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>bpim2u</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduino2</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mps2-an386</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.1</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-8.1</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>raspi3b</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>raspi2b</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>vexpress-a15</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='2'>fuji-bmc</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt-6.2</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>cheetah</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>virt-2.6</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ast2500-evb</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>highbank</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>akita</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>connex</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>netduinoplus2</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>collie</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>raspi0</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <acpi default='on' toggle='yes'/>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.197131 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     <arch name='cris'>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>axis-dev88</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:     <arch name='i686'>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 13 01:59:57.197822 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>x-remote</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 13 01:59:57.198575 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>isapc</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 13 01:59:57.199249 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>microvm</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 13 01:59:57.199836 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <domain type='kvm'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <pae/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <nonpae/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <acpi default='on' toggle='yes'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <apic default='on' toggle='no'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <arch name='m68k'>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mcf5208evb</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-7.0</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>an5206</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-6.0</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>q800</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-8.1</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-7.2</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-6.2</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-8.0</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>next-cube</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-7.1</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-6.1</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virt-8.2</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <arch name='microblaze'>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:     <arch name='microblazeel'>
May 13 01:59:57.200490 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <arch name='mips'>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>malta</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mipssim</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <arch name='mipsel'>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>malta</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mipssim</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <arch name='mips64'>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>malta</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mipssim</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>pica61</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>magnum</machine>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:     <arch name='mips64el'>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 13 01:59:57.201665 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>malta</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>loongson3-virt</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mipssim</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>pica61</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>magnum</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='16'>boston</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>fuloong2e</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <arch name='ppc'>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g3beige</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>amigaone</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mac99</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ppce500</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sam460ex</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>pegasos2</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>bamboo</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>40p</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ref405ep</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:     <arch name='ppc64'>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-noble</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>amigaone</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv9</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 13 01:59:57.202698 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv10</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ppce500</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>40p</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>pegasos2</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>bamboo</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-focal</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g3beige</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-disco</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 13 01:59:57.203586 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mac99</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-impish</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-artful</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sam460ex</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ref405ep</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv8</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:     <arch name='ppc64le'>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-noble</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>amigaone</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv9</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='15'>mpc8544ds</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv10</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ppce500</machine>
May 13 01:59:57.204316 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>40p</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>pegasos2</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>bamboo</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-focal</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>g3beige</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-disco</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>virtex-ml507</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>mac99</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-impish</machine>
May 13 01:59:57.205050 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-artful</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sam460ex</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>ref405ep</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='2048'>powernv8</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <arch name='riscv32'>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='8'>spike</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>opentitan</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='5'>sifive_u</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sifive_e</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <arch name='riscv64'>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='512'>virt</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='8'>spike</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='5'>sifive_u</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>shakti_c</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sifive_e</machine>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:     <arch name='s390x'>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 13 01:59:57.205643 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 13 01:59:57.206696 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <arch name='sh4'>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>shix</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>r2d</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <arch name='sh4eb'>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>shix</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>r2d</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:     <arch name='sparc'>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>SS-5</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>SS-20</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>LX</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>SPARCClassic</machine>
May 13 01:59:57.207349 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>leon3_generic</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>SPARCbook</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>SS-4</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>SS-600MP</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>SS-10</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>Voyager</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <arch name='sparc64'>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sun4u</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>niagara</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>sun4v</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:     <arch name='x86_64'>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <wordsize>64</wordsize>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 13 01:59:57.208334 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>x-remote</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 13 01:59:57.209186 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='1'>isapc</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 13 01:59:57.209752 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>microvm</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 13 01:59:57.210279 np0000000663 nova-compute[98103]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <domain type='kvm'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <acpi default='on' toggle='yes'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <apic default='on' toggle='no'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <arch name='xtensa'>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>sim</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>kc705</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ml605</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ml605-nommu</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>virt</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx60-nommu</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx200</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx200-nommu</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx60</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>kc705-nommu</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:   <guest>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <os_type>hvm</os_type>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:     <arch name='xtensaeb'>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <wordsize>32</wordsize>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='4'>sim</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>kc705</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ml605</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>ml605-nommu</machine>
May 13 01:59:57.210824 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>virt</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx60-nommu</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx200</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx200-nommu</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>lx60</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <machine maxCpus='32'>kc705-nommu</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <domain type='qemu'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     </arch>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <features>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <cpuselection/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <deviceboot/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <disksnapshot default='on' toggle='no'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <externalSnapshot/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     </features>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   </guest>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]: </capabilities>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]: 
May 13 01:59:57.211879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.211879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 13 01:59:57.211879 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-alpha</path>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <machine>clipper</machine>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <arch>alpha</arch>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <vcpu max='4'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.211879 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.212975 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.214394 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.214394 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 13 01:59:57.214394 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-arm</path>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <machine>virt-8.2</machine>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <arch>armv6l</arch>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.214394 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 01:59:57.215400 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.216042 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <gic supported='yes'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       <enum name='version'>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>2</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:         <value>3</value>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     </gic>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.217156 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.218573 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 13 01:59:57.218573 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-arm</path>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <machine>virt-8.2</machine>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <arch>armv6l</arch>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 01:59:57.218573 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.219779 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.220532 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <gic supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='version'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>2</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>3</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </gic>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.221716 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.221716 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 13 01:59:57.221716 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-arm</path>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <machine>virt-8.2</machine>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <arch>armv7l</arch>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.221716 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 01:59:57.222728 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.223459 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     <gic supported='yes'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       <enum name='version'>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>2</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:         <value>3</value>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.224423 np0000000663 nova-compute[98103]:     </gic>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.225815 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.225815 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 13 01:59:57.225815 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-aarch64</path>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <machine>virt-8.2</machine>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <arch>aarch64</arch>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 13 01:59:57.225815 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 13 01:59:57.226695 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.227236 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:     <gic supported='yes'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:       <enum name='version'>
May 13 01:59:57.228193 np0000000663 nova-compute[98103]:         <value>2</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>3</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     </gic>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.229480 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.229480 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 13 01:59:57.229480 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-cris</path>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <machine>axis-dev88</machine>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <arch>cris</arch>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.229480 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.230447 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.231849 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.231849 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 13 01:59:57.231849 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-i386</path>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <machine>pc-q35-noble-v2</machine>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <arch>i686</arch>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <vcpu max='1024'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.231849 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='lm'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 01:59:57.232729 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.233507 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.234139 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.235175 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.237032 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 13 01:59:57.237032 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-i386</path>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <machine>pc-i440fx-noble</machine>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <arch>i686</arch>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <vcpu max='255'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.237032 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='lm'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.238116 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.238762 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.239232 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.240220 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.241484 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 13 01:59:57.241484 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-i386</path>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <machine>pc-i440fx-noble-v2</machine>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <arch>i686</arch>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <vcpu max='255'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.241484 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='lm'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.242794 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.243563 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.244075 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.245109 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.246839 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 13 01:59:57.246839 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-i386</path>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <machine>pc-q35-noble</machine>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <arch>i686</arch>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <vcpu max='1024'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.246839 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='lm'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>qemu64</model>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.248035 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='unknown'>kvm64</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>core2duo</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Penryn</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.248690 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Conroe</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.249191 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.250199 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.251514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.251514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 13 01:59:57.251514 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-m68k</path>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <machine>mcf5208evb</machine>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <arch>m68k</arch>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.251514 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.252895 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.254268 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 13 01:59:57.254268 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-m68k</path>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <machine>virt-8.2</machine>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <arch>m68k</arch>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.254268 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.256180 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.257506 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.257506 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 13 01:59:57.257506 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-microblaze</path>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <machine>petalogix-s3adsp1800</machine>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <arch>microblaze</arch>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.257506 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.258495 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.259783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.259783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 13 01:59:57.259783 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <machine>petalogix-s3adsp1800</machine>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <arch>microblazeel</arch>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.259783 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.260838 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.262688 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.262688 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 13 01:59:57.262688 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-mips</path>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <machine>malta</machine>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <arch>mips</arch>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <vcpu max='16'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.262688 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.263713 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.265295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.265295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 13 01:59:57.265295 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-mipsel</path>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <machine>malta</machine>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <arch>mipsel</arch>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <vcpu max='16'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.265295 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.266521 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.267605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.267605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 13 01:59:57.267605 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-mips64</path>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <machine>malta</machine>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <arch>mips64</arch>
May 13 01:59:57.267605 np0000000663 nova-compute[98103]:   <vcpu max='16'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.268549 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.269835 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.271087 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.271087 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 13 01:59:57.271087 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-mips64el</path>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <machine>malta</machine>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <arch>mips64el</arch>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <vcpu max='16'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.271087 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.272067 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.273397 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.273397 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 13 01:59:57.273397 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc</path>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <machine>g3beige</machine>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <arch>ppc</arch>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.273397 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.274445 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.276016 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.276016 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 13 01:59:57.276016 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <machine>pseries-noble</machine>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <arch>ppc64</arch>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <vcpu max='4096'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.276016 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.277023 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>tpm-spapr</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>spapr-tpm-proxy</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.278047 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.279163 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 13 01:59:57.279163 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <machine>powernv9</machine>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <arch>ppc64</arch>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <vcpu max='2048'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.279163 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>tpm-spapr</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>spapr-tpm-proxy</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.280250 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.281476 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 13 01:59:57.281476 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc64</path>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <machine>pseries-noble</machine>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <arch>ppc64</arch>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <vcpu max='4096'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.281476 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.282574 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>tpm-spapr</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>spapr-tpm-proxy</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.283786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.283786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 13 01:59:57.283786 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.283786 np0000000663 nova-compute[98103]:   <machine>powernv9</machine>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <arch>ppc64le</arch>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <vcpu max='2048'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.284793 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>tpm-spapr</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>spapr-tpm-proxy</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.285913 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.287723 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 13 01:59:57.287723 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <machine>pseries-noble</machine>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <arch>ppc64le</arch>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <vcpu max='4096'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.287723 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>tpm-spapr</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:         <value>spapr-tpm-proxy</value>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.288816 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.289889 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.289889 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 13 01:59:57.289889 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-riscv32</path>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <machine>virt</machine>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <arch>riscv32</arch>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.289889 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.290890 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.292174 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.293454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.293454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 13 01:59:57.293454 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-riscv64</path>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <machine>virt</machine>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <arch>riscv64</arch>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <vcpu max='512'/>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>any</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>max</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.293454 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.294248 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.295366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.295366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 13 01:59:57.295366 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-s390x</path>
May 13 01:59:57.295366 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <machine>s390-ccw-virtio-noble</machine>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <arch>s390x</arch>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <vcpu max='248'/>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.3</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.2</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.4</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z196</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z114-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen16b</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen16a</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.5</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z196.2</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zEC12</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9BC</model>
May 13 01:59:57.296289 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13.2</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14.2</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z196-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z800</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>max</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen15b</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen15a</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z114</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13s</model>
May 13 01:59:57.297218 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890.3</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890.2</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z890-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z10BC</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>zBC12</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z990-base</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.297880 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <s390-pv supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.298896 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.300256 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.300256 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 13 01:59:57.300256 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-sh4</path>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <machine>shix</machine>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <arch>sh4</arch>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.300256 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.301747 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.303986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.303986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 13 01:59:57.303986 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <machine>shix</machine>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <arch>sh4eb</arch>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.303986 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.305708 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.306956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.306956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 13 01:59:57.306956 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-sparc</path>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <machine>SS-5</machine>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <arch>sparc</arch>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.306956 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <redirdev supported='no'/>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.308075 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='model'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.309372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.309372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 13 01:59:57.309372 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-sparc64</path>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <machine>sun4u</machine>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <arch>sparc64</arch>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <vcpu max='1'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.309372 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.310369 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.311602 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'ubuntu', 'q35'} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.311602 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 13 01:59:57.311602 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <machine>pc-q35-noble-v2</machine>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <arch>x86_64</arch>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <vcpu max='1024'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.311602 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.312685 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.313587 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314204 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.314939 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.316203 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 13 01:59:57.316203 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   <machine>pc-i440fx-noble</machine>
May 13 01:59:57.316203 np0000000663 nova-compute[98103]:   <arch>x86_64</arch>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:   <vcpu max='255'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.317264 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.318137 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.318719 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.319433 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.320640 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 13 01:59:57.320640 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.320640 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <machine>pc-i440fx-noble-v2</machine>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <arch>x86_64</arch>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <vcpu max='255'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.321803 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 01:59:57.323009 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.323647 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>ide</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.324356 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.325641 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.325641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 13 01:59:57.325641 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-x86_64</path>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <machine>pc-q35-noble</machine>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <arch>x86_64</arch>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <vcpu max='1024'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     <enum name='firmware'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <value>efi</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='yes'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <enum name='maximumMigratable'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>on</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:         <value>off</value>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='yes'>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <model fallback='forbid'>EPYC</model>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <vendor>AMD</vendor>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='acpi'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='ss'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='monitor'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='hypervisor'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='erms'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='mpx'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='pcommit'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='clwb'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='umip'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='pku'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='vaes'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='la57'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='rdpid'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='pks'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrm'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='fzrm'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrs'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='fsrc'/>
May 13 01:59:57.326814 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnowext'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='3dnow'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='xsaveerptr'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='wbnoinvd'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='npt'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='vgif'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='require' name='svme-addr-chk'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='vme'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='xsavec'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='fxsr_opt'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='misalignsse'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='osvw'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='topoext'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <feature policy='disable' name='nrip-save'/>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:     <mode name='custom' supported='yes'>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>phenom</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>pentium</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>n270</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>athlon</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 13 01:59:57.327767 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Haswell</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='AMD'>EPYC</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:       <model usable='yes' vendor='unknown'>486</model>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:     </mode>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.328444 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>vmvga</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>qxl</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>ramfb</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.329027 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <tpm supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>tpm-tis</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>tpm-crb</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>passthrough</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>emulator</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>external</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='backendVersion'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>1.2</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>2.0</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </tpm>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='yes'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <genid supported='yes'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     <hyperv supported='yes'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       <enum name='features'>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>relaxed</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>vapic</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>spinlocks</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>vpindex</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>runtime</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>synic</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>stimer</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>reset</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>vendor_id</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>frequencies</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>reenlightenment</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>tlbflush</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>ipi</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:         <value>avic</value>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:     </hyperv>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.330328 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.331492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.331492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 13 01:59:57.331492 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-xtensa</path>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <machine>sim</machine>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <arch>xtensa</arch>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <vcpu max='4'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.331492 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.332437 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.333766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98103) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 13 01:59:57.333766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 13 01:59:57.333766 np0000000663 nova-compute[98103]: <domainCapabilities>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <domain>qemu</domain>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <machine>sim</machine>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <arch>xtensaeb</arch>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <vcpu max='4'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <iothreads supported='yes'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <os supported='yes'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <enum name='firmware'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <loader supported='yes'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>rom</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>pflash</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <enum name='readonly'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>yes</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <enum name='secure'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:         <value>no</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     </loader>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   </os>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <cpu>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <mode name='host-passthrough' supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <mode name='maximum' supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <mode name='host-model' supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <mode name='custom' supported='no'/>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   </cpu>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <memoryBacking supported='yes'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <enum name='sourceType'>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <value>file</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <value>anonymous</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:       <value>memfd</value>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     </enum>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   </memoryBacking>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:   <devices>
May 13 01:59:57.333766 np0000000663 nova-compute[98103]:     <disk supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='diskDevice'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>disk</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>cdrom</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>floppy</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>lun</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>fdc</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>sata</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </disk>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <graphics supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>sdl</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>vnc</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>spice</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>egl-headless</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>dbus</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </graphics>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <video supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='modelType'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>vga</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>cirrus</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>none</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>bochs</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </video>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <hostdev supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='mode'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>subsystem</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='startupPolicy'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>default</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>mandatory</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>requisite</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>optional</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='subsysType'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>pci</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>scsi</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='capsType'/>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='pciBackend'/>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </hostdev>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <rng supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio-transitional</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtio-non-transitional</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>random</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>egd</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </rng>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <filesystem supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='driverType'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>path</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>handle</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:         <value>virtiofs</value>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     </filesystem>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <tpm supported='no'/>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:     <redirdev supported='yes'>
May 13 01:59:57.334753 np0000000663 nova-compute[98103]:       <enum name='bus'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>usb</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     </redirdev>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <channel supported='yes'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>pty</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>unix</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>spicevmc</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     </channel>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <crypto supported='yes'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       <enum name='model'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>virtio</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       <enum name='type'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>qemu</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       <enum name='backendModel'>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:         <value>builtin</value>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:       </enum>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     </crypto>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:   </devices>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:   <features>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <gic supported='no'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <vmcoreinfo supported='no'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <genid supported='no'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <backingStoreInput supported='yes'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <backup supported='yes'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <async-teardown supported='yes'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <sev supported='no'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:     <sgx supported='no'/>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:   </features>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]: </domainCapabilities>
May 13 01:59:57.335953 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 13 01:59:57.335953 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Checking secure boot support for host arch (x86_64) {{(pid=98103) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 13 01:59:57.335953 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Secure Boot support detected
May 13 01:59:57.811716 np0000000663 nova-compute[98103]: INFO nova.virt.node [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Generated node identity 97b2898b-d3c3-45e4-a1d2-ef71603b8684
May 13 01:59:57.811976 np0000000663 nova-compute[98103]: INFO nova.virt.node [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Wrote node identity 97b2898b-d3c3-45e4-a1d2-ef71603b8684 to /opt/stack/data/nova/compute_id
May 13 01:59:58.314339 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Compute nodes ['97b2898b-d3c3-45e4-a1d2-ef71603b8684'] for host np0000000663 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 13 01:59:59.317801 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 13 02:00:00.322230 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] No compute node record found for host np0000000663. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000000663 could not be found.
May 13 02:00:00.322669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:00:00.322669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:00:00.322669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:00:00.322814 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:00:00.381318 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:00:00.382046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:00:00.396356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:00:00.396689 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Hypervisor/Node resource view: name=np0000000663 free_ram=16724MB free_disk=75.24822998046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:00:00.396831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:00:00.397064 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:00:00.899951 np0000000663 nova-compute[98103]: WARNING nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] No compute node record for np0000000663:97b2898b-d3c3-45e4-a1d2-ef71603b8684: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 97b2898b-d3c3-45e4-a1d2-ef71603b8684 could not be found.
May 13 02:00:01.404975 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Compute node record created for np0000000663:np0000000663 with uuid: 97b2898b-d3c3-45e4-a1d2-ef71603b8684
May 13 02:00:02.912790 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:00:02.913228 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:00:00 up 23 min,  2 users,  load average: 2.14, 1.54, 0.80\n'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:00:03.334526 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] [req-d1bb027c-a9b3-4658-bbef-7d8489d98130] Created resource provider record via placement API for resource provider with UUID 97b2898b-d3c3-45e4-a1d2-ef71603b8684 and name np0000000663.
May 13 02:00:03.387727 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 13 02:00:03.387727 np0000000663 nova-compute[98103]: ] {{(pid=98103) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 13 02:00:03.387843 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.host [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] kernel doesn't support AMD SEV
May 13 02:00:03.388031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:00:03.388219 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:00:03.388461 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:00:03.392163 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Libvirt baseline CPU <cpu>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:   <arch>x86_64</arch>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:   <model>Nehalem</model>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:   <vendor>AMD</vendor>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:   <topology sockets="12" cores="1" threads="1"/>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:   <maxphysaddr mode="emulate" bits="40"/>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]: </cpu>
May 13 02:00:03.392163 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 13 02:00:03.956967 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Updated inventory for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 13 02:00:03.957405 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Updating resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 generation from 0 to 1 during operation: update_inventory {{(pid=98103) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 13 02:00:03.957405 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:00:04.091407 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Updating resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 generation from 1 to 2 during operation: update_traits {{(pid=98103) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 13 02:00:04.600490 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:00:04.600635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.204s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:00:04.600819 np0000000663 nova-compute[98103]: DEBUG nova.service [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98103) start /opt/stack/nova/nova/service.py:195}}
May 13 02:00:04.615068 np0000000663 nova-compute[98103]: DEBUG nova.service [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98103) start /opt/stack/nova/nova/service.py:211}}
May 13 02:00:04.632513 np0000000663 nova-compute[98103]: DEBUG nova.service [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] Join ServiceGroup membership for this service compute {{(pid=98103) start /opt/stack/nova/nova/service.py:221}}
May 13 02:00:04.632806 np0000000663 nova-compute[98103]: DEBUG nova.servicegroup.drivers.db [None req-e16770f2-bd2a-4947-baaf-b5985700c4a2 None None] DB_Driver: join new ServiceGroup member np0000000663 to the compute group, service = <Service: host=np0000000663, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98103) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 13 02:00:10.136170 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:00:19.635060 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_power_states {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:20.137987 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:20.138910 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.75 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:00:43.884918 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.885466 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.885466 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.885584 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.885743 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.885924 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.886119 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:43.886262 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:00:43.886408 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:00:44.389787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:00:44.390029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:00:44.390130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:00:44.390197 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:00:44.398002 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:00:44.398856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:00:44.413688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.015s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:00:44.414355 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=16426MB free_disk=75.1171646118164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:00:44.414540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:00:44.414783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:00:45.473706 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:00:45.473706 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:00:44 up 24 min,  2 users,  load average: 2.09, 1.60, 0.85\n'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:00:45.513934 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:00:45.513934 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:00:46.018112 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:00:46.521679 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:00:46.522446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.108s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:00:46.522903 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:01:46.515734 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.516078 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.516265 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.516512 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.516722 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.516923 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.517122 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.517338 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:46.517486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:01:46.517695 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:01:47.021236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:01:47.021393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:01:47.021546 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:01:47.021613 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:01:47.029366 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:01:47.030000 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:01:47.043205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:01:47.043528 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=16387MB free_disk=74.91613388061523GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:01:47.043665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:01:47.043871 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:01:48.098110 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:01:48.098110 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:01:47 up 25 min,  2 users,  load average: 1.40, 1.52, 0.88\n'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:01:48.137103 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:01:48.137103 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:01:48.639059 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:01:49.144796 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:01:49.145310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:01:49.145310 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:02:10.138235 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:02:30.892824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:30.893380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:31.395087 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:32.000716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:32.001597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:32.007074 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:32.007345 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Claim successful on node np0000000663
May 13 02:02:33.143437 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:33.143918 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:33.646105 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:34.152739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.152s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:34.153258 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:34.659506 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:34.659757 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:34.660656 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:34.661966 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:35.164183 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:35.502729 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff4dd8b153c4ae98a37ba022bb538c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9a7e74db544084a4907abd0f241e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:35.669698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:36.688500 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:36.689983 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:36.690340 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Creating image(s)
May 13 02:02:36.691062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:36.691302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:36.691899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:36.692359 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:36.693271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:37.015584 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:37.018525 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:37.018906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:37.089806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.part --force-share --output=json" returned: 0 in 0.070s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:37.090574 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ce64da57-4ea7-4983-8f5e-9324f00e60fa was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:02:37.091789 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:02:37.092160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.part /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:37.245147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.part /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.converted" returned: 0 in 0.153s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:37.250731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:37.309799 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0.converted --force-share --output=json" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:37.311311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.618s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:37.312488 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:37.315562 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:37.316482 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpipwk9ttz/privsep.sock']
May 13 02:02:37.325299 np0000000663 sudo[109799]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpipwk9ttz/privsep.sock
May 13 02:02:37.325877 np0000000663 sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 02:02:37.562504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:37.562736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:37.587474 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 02:02:37.587769 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:37.587769 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:37.587769 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:37.587769 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:37.587769 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:37.588791 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:37.588791 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:37.588791 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 02:02:37.594056 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Successfully created port: 6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:37.938393 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 02:02:37.938393 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:37.938905 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 02:02:38.066087 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:38.211519 np0000000663 sudo[109799]: pam_unix(sudo:session): session closed for user root
May 13 02:02:38.212944 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Spawned new privsep daemon via rootwrap
May 13 02:02:38.214398 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 13 02:02:38.214564 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 13 02:02:38.214700 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 13 02:02:38.214824 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109830
May 13 02:02:38.302128 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:38.377369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.078s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:38.380219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:38.380219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:38.380219 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:38.383407 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:38.383407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:38.450051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.066s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:38.450577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:38.481211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk 1073741824" returned: 0 in 0.030s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:38.481675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.103s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:38.481991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:38.548977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:38.549222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:38.562741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.081s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:38.563367 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:38.563715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:38.631317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:38.631680 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Cannot resize image /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:38.632145 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:38.632349 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:38.632664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:38.632939 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:38.633136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:38.649551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:38.649733 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:38.652298 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:38.652473 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Claim successful on node np0000000663
May 13 02:02:38.869937 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Successfully updated port: 6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:39.051681 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:39.372820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:39.372820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquired lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:39.373010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:39.476450 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-changed-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:39.477222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Refreshing instance network info cache due to event network-changed-6865b153-a6fa-487c-8945-9b5ea38fc3d0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:39.477222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] Acquiring lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:39.610675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:39.986384 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:39.987046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:40.000511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:40.000715 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:40.025022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:40.025225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:40.171631 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:40.360842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:40.361530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:40.437033 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:40.488797 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:40.505145 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:40.526964 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:40.740897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating instance_info_cache with network_info: [{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:40.864749 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:41.012049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.362s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:41.012632 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:41.016358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.406s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:41.020394 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:41.020585 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Claim successful on node np0000000663
May 13 02:02:41.042967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:41.084637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Releasing lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Instance network_info: |[{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] Acquired lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Refreshing network info cache for port 6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Start _get_guest_xml network_info=[{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:41.633615 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1114422483', uuid='b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3'), owner=OwnerMeta(userid='0ff4dd8b153c4ae98a37ba022bb538c6', username='tempest-AttachVolumeNegativeTest-603660763-project-member', projectid='4b9a7e74db544084a4907abd0f241e8b', projectname='tempest-AttachVolumeNegativeTest-603660763'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637761.2555492) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:41.634584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:41.635583 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:02:41.636187 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1114422483',display_name='tempest-AttachVolumeNegativeTest-server-1114422483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1114422483',id=1,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE5/jqy0eWYc8TEo2LIFpbU1YLfIk/osIaUir/PFKpG7OPDuM+Oo4JeaRtqljanA9KV6lsKzs2pX7ltH0Oa/AWvOVfV2LFxS430wxbpLFVX/H6P13/BJeAJWJ0se6xN0A==',key_name='tempest-keypair-6940213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-0z7b0i85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:41.636187 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:41.636187 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'pci_devices' on Instance uuid b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:41.636625 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cb5a50d9fe9464e9ad258c960828d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6194cae22b64d2c9601d523690e9ed9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:41.748866 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:41.795813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <uuid>b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3</uuid>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <name>instance-00000001</name>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1114422483</nova:name>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:41</nova:creationTime>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:user uuid="0ff4dd8b153c4ae98a37ba022bb538c6">tempest-AttachVolumeNegativeTest-603660763-project-member</nova:user>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:project uuid="4b9a7e74db544084a4907abd0f241e8b">tempest-AttachVolumeNegativeTest-603660763</nova:project>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         <nova:port uuid="6865b153-a6fa-487c-8945-9b5ea38fc3d0">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="serial">b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="uuid">b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.config"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7d:c5:f9"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <target dev="tap6865b153-a6"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/console.log" append="off"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:41.795813 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:41.798661 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Preparing to wait for external event network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:41.798661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:41.798661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:41.798661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:41.798661 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1114422483',display_name='tempest-AttachVolumeNegativeTest-server-1114422483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1114422483',id=1,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE5/jqy0eWYc8TEo2LIFpbU1YLfIk/osIaUir/PFKpG7OPDuM+Oo4JeaRtqljanA9KV6lsKzs2pX7ltH0Oa/AWvOVfV2LFxS430wxbpLFVX/H6P13/BJeAJWJ0se6xN0A==',key_name='tempest-keypair-6940213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-0z7b0i85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:41.799011 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:41.799011 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:41.799011 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:41.860933 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Created schema index Interface.name {{(pid=98103) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 02:02:41.861115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Created schema index Port.name {{(pid=98103) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 02:02:41.861207 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Created schema index Bridge.name {{(pid=98103) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 13 02:02:41.861805 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:02:41.861928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [POLLOUT] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.862040 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:02:41.862538 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.863852 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.882842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.898286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.898470 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:41.898719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:41.899720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.899928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bc5cf4b-d978-5f5b-890c-3ece8fee662a', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:41.900840 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.901497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:41.901635 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:41.903902 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd34d95z1/privsep.sock']
May 13 02:02:41.913489 np0000000663 sudo[109918]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd34d95z1/privsep.sock
May 13 02:02:41.914737 np0000000663 sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 02:02:42.025833 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:42.191402 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 02:02:42.191402 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:42.191402 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:42.191515 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:42.191515 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:42.191842 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:42.191842 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:42.192184 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:42.192236 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 02:02:42.203295 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Successfully created port: a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:42.375363 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:42.483216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:42.483216 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:42.506388 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 02:02:42.506728 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:42.506728 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:42.506728 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:42.506728 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:42.506854 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:42.506854 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:42.506854 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:42.507107 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 02:02:42.529650 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:42.676208 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updated VIF entry in instance network info cache for port 6865b153-a6fa-487c-8945-9b5ea38fc3d0. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:02:42.676753 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating instance_info_cache with network_info: [{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:42.715790 np0000000663 sudo[109918]: pam_unix(sudo:session): session closed for user root
May 13 02:02:42.717851 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Spawned new privsep daemon via rootwrap
May 13 02:02:42.718727 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 13 02:02:42.718812 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 13 02:02:42.718855 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 13 02:02:42.718942 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109925
May 13 02:02:42.833969 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Successfully updated port: a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:42.985001 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:43.011178 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:43.011799 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6865b153-a6, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:43.012021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6865b153-a6, col_values=(('qos', UUID('6d15cdf9-b248-43e7-b355-69f74af6a77b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:43.013019 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6865b153-a6, col_values=(('external_ids', {'iface-id': '6865b153-a6fa-487c-8945-9b5ea38fc3d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:c5:f9', 'vm-uuid': 'b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:43.014151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:43.015203 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:43.024812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:43.027200 np0000000663 nova-compute[98103]: INFO os_vif [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6')
May 13 02:02:43.180062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-caf70c50-d068-4a59-896f-fada7650aee1 req-a7a5f3fc-cd41-4ccb-84a9-d162db472ae2 service nova] Releasing lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:43.289943 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-changed-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:43.290190 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Refreshing instance network info cache due to event network-changed-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:43.290628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] Acquiring lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:43.290628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] Acquired lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:43.290761 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Refreshing network info cache for port a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:43.335780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:43.492823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.476s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:43.493049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:43.495654 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.453s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:43.499937 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:43.499937 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Claim successful on node np0000000663
May 13 02:02:43.552238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:43.553753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:43.554050 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Creating image(s)
May 13 02:02:43.554564 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:43.554757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:43.556654 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:43.557139 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:43.560822 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:43.563261 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:43.643586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:43.643586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:43.643586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:43.643586 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:43.645710 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:43.646010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:43.704730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:43.704730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:43.732410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk 1073741824" returned: 0 in 0.027s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:43.735160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.090s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:43.735160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:43.793974 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:43.802247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.069s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:43.802833 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:43.803164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:43.871222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json" returned: 0 in 0.067s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Cannot resize image /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Ensure instance console log exists: /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:43.873300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:43.889172 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:44.001694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:44.002189 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:44.002236 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:44.002535 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:44.059772 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:44.097412 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abbf989ad455457b9f26484098001164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd9cdc95eb54a1fb998d954aad862a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:44.507621 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 13 02:02:44.554588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:44.554739 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:44.554893 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:7d:c5:f9, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:44.555399 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Using config drive
May 13 02:02:44.562942 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8bd466db-3248-4420-9ec6-fc3bd1343a5f req-90c0474b-ad84-4b25-bd45-6b9c04c7a73c service nova] Releasing lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:44.563772 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquired lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:44.563772 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:44.897605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:44.898045 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:45.015628 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:45.044188 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:45.062719 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:45.068392 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Successfully created port: 040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:45.198729 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:45.401147 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:45.676816 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Successfully updated port: 040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:45.746641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-changed-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:45.746811 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Refreshing instance network info cache due to event network-changed-040d625d-14d0-402b-b2da-88af0ae26f43. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:45.747223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] Acquiring lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:45.747223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] Acquired lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:45.747223 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Refreshing network info cache for port 040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:45.834921 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Creating config drive at /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.config
May 13 02:02:45.838755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpytris_ci {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:45.875689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpytris_ci" returned: 0 in 0.037s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:45.882477 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:45.910278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.415s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:45.911549 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.826s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:45.911549 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:45.918146 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:45.918346 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Claim successful on node np0000000663
May 13 02:02:46.025299 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:46.026453 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:46.027147 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Creating image(s)
May 13 02:02:46.027555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:46.027835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:46.028209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:46.028448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "644b6da08685a2314fd726efa57fd942864d7108" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:46.028760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "644b6da08685a2314fd726efa57fd942864d7108" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:46.074923 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating instance_info_cache with network_info: [{"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:46.178811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:46.249640 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:46.346733 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:46.384456 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:46.406517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:46.430708 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:46.430967 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:46.431462 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:46.432134 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:46.516442 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:46.524274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:46.525878 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:46.526064 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:46.578692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Releasing lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:46.579007 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance network_info: |[{"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:46.582271 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Start _get_guest_xml network_info=[{"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:46.588115 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fddb84e700c34bcb911bea020c300727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54e73cd5d334cb59d7e916a47e98db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:46.589551 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:46.592840 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1785590323', uuid='90b73edb-7021-4d08-90fe-4cd3f5678c7c'), owner=OwnerMeta(userid='5cb5a50d9fe9464e9ad258c960828d6e', username='tempest-VolumesAssistedSnapshotsTest-751673082-project-member', projectid='a6194cae22b64d2c9601d523690e9ed9', projectname='tempest-VolumesAssistedSnapshotsTest-751673082'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637766.592286) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:46.600887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:46.603852 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:46.604880 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:46.605208 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:46.606797 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:46.607368 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:46.607612 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:46.607826 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:46.608160 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:46.608316 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:46.608537 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:46.608753 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:46.609208 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:46.610628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:46.610628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:46.610628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:46.627324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785590323',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785590323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesassistedsnapshotstest-server-1785590323',id=2,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0xsyIvuVkUaUXZyC8LFAM3d9MOQAlYTQGTzbA4ofVyyO3Wx7IE0e0WgS4KfGU50Ajagyg6IdJ7B1hDbnnbQJWn5DkHTwIsT8nyxyyCvA0R+UuSyNuHww2i9HWfUpDlXQ==',key_name='tempest-keypair-31812889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6194cae22b64d2c9601d523690e9ed9',ramdisk_id='',reservation_id='r-1nw8hy7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-751673082',owner_user_name='tempest-VolumesAssistedSnapshotsTest-751673082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb5a50d9fe9464e9ad258c960828d6e',uuid=90b73edb-7021-4d08-90fe-4cd3f5678c7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:46.627595 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converting VIF {"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:46.628463 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:46.633131 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lazy-loading 'pci_devices' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:46.661119 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:46.929619 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:46.948845 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:46.953203 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:46.953664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.030971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:47.059133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.part --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.060492 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] 4d79732b-80a3-4131-80e8-6651e8ba49ae was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:02:47.062236 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:02:47.062627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.part /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.137258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <uuid>90b73edb-7021-4d08-90fe-4cd3f5678c7c</uuid>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <name>instance-00000002</name>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1785590323</nova:name>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:46</nova:creationTime>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:user uuid="5cb5a50d9fe9464e9ad258c960828d6e">tempest-VolumesAssistedSnapshotsTest-751673082-project-member</nova:user>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:project uuid="a6194cae22b64d2c9601d523690e9ed9">tempest-VolumesAssistedSnapshotsTest-751673082</nova:project>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         <nova:port uuid="a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="serial">90b73edb-7021-4d08-90fe-4cd3f5678c7c</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="uuid">90b73edb-7021-4d08-90fe-4cd3f5678c7c</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.config"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:06:13:9a"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <target dev="tapa24e67c8-24"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/console.log" append="off"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:47.137258 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:47.142811 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Preparing to wait for external event network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:47.142811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:47.142811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:47.142811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:47.142811 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785590323',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785590323',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesassistedsnapshotstest-server-1785590323',id=2,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0xsyIvuVkUaUXZyC8LFAM3d9MOQAlYTQGTzbA4ofVyyO3Wx7IE0e0WgS4KfGU50Ajagyg6IdJ7B1hDbnnbQJWn5DkHTwIsT8nyxyyCvA0R+UuSyNuHww2i9HWfUpDlXQ==',key_name='tempest-keypair-31812889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6194cae22b64d2c9601d523690e9ed9',ramdisk_id='',reservation_id='r-1nw8hy7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-751673082',owner_user_name='tempest-VolumesAssistedSnapshotsTest-751673082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb5a50d9fe9464e9ad258c960828d6e',uuid=90b73edb-7021-4d08-90fe-4cd3f5678c7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:47.143069 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converting VIF {"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:47.143069 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:47.143541 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:47.144401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.144852 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:47.145318 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:47.146726 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.147019 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95811a30-aac8-5cc5-98fa-1f9d959dcb9e', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:47.148795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.150420 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:47.156760 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Successfully created port: 772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:47.160670 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.160961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa24e67c8-24, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:47.161551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa24e67c8-24, col_values=(('qos', UUID('3760ae0a-14ba-4c71-806d-6e3321e627cc')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:47.162016 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa24e67c8-24, col_values=(('external_ids', {'iface-id': 'a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:13:9a', 'vm-uuid': '90b73edb-7021-4d08-90fe-4cd3f5678c7c'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:47.162927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.164118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:47.165599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e13a8f-9fb3-4d0a-b4cd-97b729d6c156 req-c2befab4-1032-47c6-9531-58e74a8681e6 service nova] Releasing lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:47.165996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquired lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:47.166386 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:47.170853 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:47.172031 np0000000663 nova-compute[98103]: INFO os_vif [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24')
May 13 02:02:47.259414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.part /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.converted" returned: 0 in 0.197s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.265480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.352698 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108.converted --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.353527 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "644b6da08685a2314fd726efa57fd942864d7108" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.325s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:47.354170 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:47.358665 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:47.359991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.437333 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778637767.436777, b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:47.437664 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] VM Started (Lifecycle Event)
May 13 02:02:47.442711 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.443717 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "644b6da08685a2314fd726efa57fd942864d7108" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:47.444244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "644b6da08685a2314fd726efa57fd942864d7108" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:47.444889 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:47.447984 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:47.448324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.457684 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:47.536769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.537365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108,backing_fmt=raw /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.538035 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:47.538323 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:47.569920 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108,backing_fmt=raw /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk 1073741824" returned: 0 in 0.032s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.570502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "644b6da08685a2314fd726efa57fd942864d7108" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.126s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:47.570912 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.635042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:47.649945 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/644b6da08685a2314fd726efa57fd942864d7108 --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.650337 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:47.650664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:47.734269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:47.734789 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Cannot resize image /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:47.735274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:47.735601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Ensure instance console log exists: /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:47.735960 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:47.736257 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:47.736507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:47.790105 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Successfully updated port: 772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:47.941351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:47.942824 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637767.9425764, b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:47.942959 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] VM Paused (Lifecycle Event)
May 13 02:02:47.953075 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:48.027922 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-changed-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:48.028061 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Refreshing instance network info cache due to event network-changed-772c3f74-65ab-4239-a55b-7ecf08c6bc79. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:48.028265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] Acquiring lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:48.028371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] Acquired lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:48.028511 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Refreshing network info cache for port 772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:48.062965 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:48.092490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:48.291836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:48.395506 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:48.447975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:48.449410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:48.480193 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:48.482523 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:48.482922 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Creating image(s)
May 13 02:02:48.484025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:48.484260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:48.486112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:48.486112 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:48.489893 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:48.491818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:48.539508 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:48.563507 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updating instance_info_cache with network_info: [{"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:48.564967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.073s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:48.565377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:48.566087 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:48.567313 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:48.569296 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:48.570522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.660s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:48.571536 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:48.572844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 7.141s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:48.574895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:48.594220 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:48.595935 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Claim successful on node np0000000663
May 13 02:02:48.650845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:48.651788 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:48.654216 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:48.687736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk 1073741824" returned: 0 in 0.036s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:48.688173 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.122s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:48.688465 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:48.711258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:48.711258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:48.711258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] No VIF found with MAC fa:16:3e:06:13:9a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:48.711258 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Using config drive
May 13 02:02:48.764829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:48.764829 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:48.764829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:48.838038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Cannot resize image /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Ensure instance console log exists: /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:48.841121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:48.941671 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:48.946423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:48.946423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:48.946684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:48.946822 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:48.947341 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] No event matching network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 in dict_keys([('network-vif-plugged', '6865b153-a6fa-487c-8945-9b5ea38fc3d0')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:02:48.947824 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7c558f28-19b1-48e8-b997-fc1a17f11ca9 req-776d4991-9a55-4572-a51c-bc7630090504 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received unexpected event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 for instance with vm_state building and task_state spawning.
May 13 02:02:48.955712 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:02:49.066882 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Releasing lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:49.067346 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance network_info: |[{"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:49.069837 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Start _get_guest_xml network_info=[{"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:02:24Z,direct_url=<?>,disk_format='qcow2',id=4d79732b-80a3-4131-80e8-6651e8ba49ae,min_disk=0,min_ram=0,name='',owner='2bb8d43fdf4c4590ae709d58cb5d158d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:02:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_options': None, 'image_id': '4d79732b-80a3-4131-80e8-6651e8ba49ae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:49.072567 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:49.073568 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='4d79732b-80a3-4131-80e8-6651e8ba49ae', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-1670296637', uuid='ed53f547-41ea-4014-a290-8be7d50148aa'), owner=OwnerMeta(userid='abbf989ad455457b9f26484098001164', username='tempest-AttachSCSIVolumeTestJSON-1712914803-project-member', projectid='5bd9cdc95eb54a1fb998d954aad862a2', projectname='tempest-AttachSCSIVolumeTestJSON-1712914803'), image=ImageMeta(id='4d79732b-80a3-4131-80e8-6651e8ba49ae', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637769.0729969) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:49.076382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:49.079326 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:49.080225 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:49.080465 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:49.080848 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:49.081165 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:49.086455 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:49.086455 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:49.087194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:49.087567 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:02:24Z,direct_url=<?>,disk_format='qcow2',id=4d79732b-80a3-4131-80e8-6651e8ba49ae,min_disk=0,min_ram=0,name='',owner='2bb8d43fdf4c4590ae709d58cb5d158d',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:02:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:49.087737 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:49.087846 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:49.088683 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:49.088995 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:49.088995 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:49.105879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1670296637',display_name='tempest-AttachSCSIVolumeTestJSON-server-1670296637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachscsivolumetestjson-server-1670296637',id=3,image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/f04crFB9EGgxBCj/CZMxoufrru1xmdTDjboSKQ6gmTKAjTcFKFugZD+2bZSDoxmHe84wLbT5/UO+wg7I1eU3Jp0fj68sYFIo0siLa631W+Z1v/R7fk+rdTmlm8i45iw==',key_name='tempest-keypair-267749851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9cdc95eb54a1fb998d954aad862a2',ramdisk_id='',reservation_id='r-yzamwf4e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1712914803',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1712914803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abbf989ad455457b9f26484098001164',uuid=ed53f547-41ea-4014-a290-8be7d50148aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:49.106075 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converting VIF {"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:49.106914 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:49.107671 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lazy-loading 'pci_devices' on Instance uuid ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:49.145848 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.146243 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.146484 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.146702 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.146949 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.147216 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.147406 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.147590 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:02:49.147808 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:02:49.169105 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.175503 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.177926 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.198227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.203666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.218685 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:49.278050 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.390063 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fddb84e700c34bcb911bea020c300727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54e73cd5d334cb59d7e916a47e98db7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:49.446676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2228f12d-a87f-4786-a292-01d2b804eece req-0db4c555-7c88-40fe-acd9-b252951195f3 service nova] Releasing lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:49.447220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquired lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:49.447409 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:49.580843 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:49.614394 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <uuid>ed53f547-41ea-4014-a290-8be7d50148aa</uuid>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <name>instance-00000003</name>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1670296637</nova:name>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:49</nova:creationTime>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:image uuid="4d79732b-80a3-4131-80e8-6651e8ba49ae">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:user uuid="abbf989ad455457b9f26484098001164">tempest-AttachSCSIVolumeTestJSON-1712914803-project-member</nova:user>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:project uuid="5bd9cdc95eb54a1fb998d954aad862a2">tempest-AttachSCSIVolumeTestJSON-1712914803</nova:project>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="4d79732b-80a3-4131-80e8-6651e8ba49ae"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         <nova:port uuid="040d625d-14d0-402b-b2da-88af0ae26f43">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="serial">ed53f547-41ea-4014-a290-8be7d50148aa</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="uuid">ed53f547-41ea-4014-a290-8be7d50148aa</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <target dev="sda" bus="scsi"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <address type="drive" controller="0" unit="0"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.config"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <target dev="sdb" bus="scsi"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <address type="drive" controller="0" unit="1"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:ec:a9:ef"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <target dev="tap040d625d-14"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/console.log" append="off"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:49.614394 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:49.616847 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Preparing to wait for external event network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:49.616847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:49.616847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:49.616847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:49.616847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1670296637',display_name='tempest-AttachSCSIVolumeTestJSON-server-1670296637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachscsivolumetestjson-server-1670296637',id=3,image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/f04crFB9EGgxBCj/CZMxoufrru1xmdTDjboSKQ6gmTKAjTcFKFugZD+2bZSDoxmHe84wLbT5/UO+wg7I1eU3Jp0fj68sYFIo0siLa631W+Z1v/R7fk+rdTmlm8i45iw==',key_name='tempest-keypair-267749851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bd9cdc95eb54a1fb998d954aad862a2',ramdisk_id='',reservation_id='r-yzamwf4e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1712914803',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1712914803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abbf989ad455457b9f26484098001164',uuid=ed53f547-41ea-4014-a290-8be7d50148aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:49.617261 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converting VIF {"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:49.617261 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:49.617364 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:49.618671 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.618891 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:49.619325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:49.620951 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.622028 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5207725f-33e1-5f8a-b63f-f7b9e392464f', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:49.623332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.623860 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:49.630822 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.635625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.635625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap040d625d-14, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:49.635625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap040d625d-14, col_values=(('qos', UUID('913348e1-c473-4e5d-a380-8123b95080be')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:49.635625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap040d625d-14, col_values=(('external_ids', {'iface-id': '040d625d-14d0-402b-b2da-88af0ae26f43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:a9:ef', 'vm-uuid': 'ed53f547-41ea-4014-a290-8be7d50148aa'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:49.636527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.637599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:49.648970 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:49.649770 np0000000663 nova-compute[98103]: INFO os_vif [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14')
May 13 02:02:49.652368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:49.738268 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Creating config drive at /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.config
May 13 02:02:49.747029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi1eoxyhe {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:49.777827 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi1eoxyhe" returned: 0 in 0.030s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:50.045517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.071199 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:50.071199 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:50.084685 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:50.213568 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.243400 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.341136 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.530443 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.537878 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.542209 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.560149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.570365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:50.575619 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:50.834978 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Successfully created port: b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:50.860171 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:51.084480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.085896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:51.088666 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.450s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.093678 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:51.093900 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Claim successful on node np0000000663
May 13 02:02:51.099240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:51.099560 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:51.099800 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Creating image(s)
May 13 02:02:51.101895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.101895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.102037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.102714 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:51.108167 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:51.109273 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.142800 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637771.1422322, 90b73edb-7021-4d08-90fe-4cd3f5678c7c => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:51.142984 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] VM Started (Lifecycle Event)
May 13 02:02:51.169900 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No BDM found with device name sda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:51.170012 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:51.170136 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No VIF found with MAC fa:16:3e:ec:a9:ef, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:51.170804 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Using config drive
May 13 02:02:51.181576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:51.182004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.182559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.182963 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:51.185788 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:51.186412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.251038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:51.251700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.280380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:51.283628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk 1073741824" returned: 0 in 0.032s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:51.284403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.102s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.284766 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.361057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:51.361971 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:51.362553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.437851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:51.438317 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Cannot resize image /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:51.438768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:51.438985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Ensure instance console log exists: /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:51.439381 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.443111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.443111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.524573 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Successfully updated port: b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:51.571047 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:51.595063 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:51.595326 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:51.595804 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:51.596209 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:51.647310 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:51.651160 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637771.649556, 90b73edb-7021-4d08-90fe-4cd3f5678c7c => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:51.651160 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] VM Paused (Lifecycle Event)
May 13 02:02:51.672240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:51.673209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.673499 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.673861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.673861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] No event matching network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 in dict_keys([('network-vif-plugged', '040d625d-14d0-402b-b2da-88af0ae26f43')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:02:51.674182 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received unexpected event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 for instance with vm_state building and task_state spawning.
May 13 02:02:51.674182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:51.674262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.675106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.675106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.675106 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Processing event network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:02:51.675106 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:51.676422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:51.682253 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:51.682316 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:02:51.683298 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:51.686572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:51.686980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] No waiting events found dispatching network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:02:51.688198 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7deaf602-18a5-4b06-9e2f-d05432b5336b req-b87c6c19-4674-493c-8ad5-f5244d0e5517 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received unexpected event network-vif-plugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 for instance with vm_state building and task_state spawning.
May 13 02:02:51.688748 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:02:51.692396 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Instance spawned successfully.
May 13 02:02:51.692835 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:02:51.709116 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40c041c0760e4f5c95781ea71d381e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '897c073eaf9e4d5a818c1cf67ccd759a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:51.709116 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:51.915799 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Creating config drive at /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.config
May 13 02:02:51.920628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0bt3ihm8 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:51.934428 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updating instance_info_cache with network_info: [{"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:51.964557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0bt3ihm8" returned: 0 in 0.044s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:52.027995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:52.028123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquired lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:52.028287 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:52.100738 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:52.153797 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:52.157962 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:52.206028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.206389 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.206845 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.207323 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.207956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.207956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:52.441962 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Releasing lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:52.442328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance network_info: |[{"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:52.444016 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Start _get_guest_xml network_info=[{"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:52.448673 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:52.450191 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-123586797-1', uuid='a3598ffd-b2b9-472d-bc0b-187a6f5ffae6'), owner=OwnerMeta(userid='fddb84e700c34bcb911bea020c300727', username='tempest-TestMultiAttachVolumeSwap-17294794-project-member', projectid='a54e73cd5d334cb59d7e916a47e98db7', projectname='tempest-TestMultiAttachVolumeSwap-17294794'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637772.4496477) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:52.452386 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:52.452811 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:52.454428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:52.454786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:52.455824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:52.456214 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:52.456455 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:52.456455 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:52.456632 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:52.456723 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:52.456839 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:52.456991 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:52.457106 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:52.457238 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:52.457343 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:52.457511 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:52.474549 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-1',id=4,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=a3598ffd-b2b9-472d-bc0b-187a6f5ffae6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:52.474743 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:52.475928 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:52.477268 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'pci_devices' on Instance uuid a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:52.491885 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.511015 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.516403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.608292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:52.633772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.635427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:52.635738 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:52.657664 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:52.662601 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:02:52.663476 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637772.6631994, b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:52.663623 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] VM Resumed (Lifecycle Event)
May 13 02:02:52.716230 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Took 16.03 seconds to spawn the instance on the hypervisor.
May 13 02:02:52.716701 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:52.874242 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.879923 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.881309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.900718 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.905016 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:52.981114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <uuid>a3598ffd-b2b9-472d-bc0b-187a6f5ffae6</uuid>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <name>instance-00000004</name>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-123586797-1</nova:name>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:52</nova:creationTime>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:user uuid="fddb84e700c34bcb911bea020c300727">tempest-TestMultiAttachVolumeSwap-17294794-project-member</nova:user>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:project uuid="a54e73cd5d334cb59d7e916a47e98db7">tempest-TestMultiAttachVolumeSwap-17294794</nova:project>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         <nova:port uuid="772c3f74-65ab-4239-a55b-7ecf08c6bc79">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="serial">a3598ffd-b2b9-472d-bc0b-187a6f5ffae6</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="uuid">a3598ffd-b2b9-472d-bc0b-187a6f5ffae6</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.config"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:cc:d2:47"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <target dev="tap772c3f74-65"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/console.log" append="off"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:52.981114 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:52.983215 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Preparing to wait for external event network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:52.983215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:52.983215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:52.983215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:52.983215 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-1',id=4,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=a3598ffd-b2b9-472d-bc0b-187a6f5ffae6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:52.983505 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:52.983809 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:52.984251 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:52.984733 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.985010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:52.985264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:52.986118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.986269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed4b91fa-c009-5ab1-aad6-c324d319f693', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:52.987108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.989411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.989411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.999370 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:52.999940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap772c3f74-65, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:53.000428 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap772c3f74-65, col_values=(('qos', UUID('da8fc8e1-ed9b-4848-a9c3-20be1aa7fc0b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:53.000735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap772c3f74-65, col_values=(('external_ids', {'iface-id': '772c3f74-65ab-4239-a55b-7ecf08c6bc79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:d2:47', 'vm-uuid': 'a3598ffd-b2b9-472d-bc0b-187a6f5ffae6'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:53.003263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:53.003263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:53.011810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:53.012927 np0000000663 nova-compute[98103]: INFO os_vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65')
May 13 02:02:53.140450 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:53.167871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:53.171670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:53.186893 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating instance_info_cache with network_info: [{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:53.232869 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Took 21.33 seconds to build instance.
May 13 02:02:53.576500 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Successfully created port: d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:53.620824 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:02:53.621822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:02:53.622078 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Creating image(s)
May 13 02:02:53.622603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:53.622754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:53.624585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:53.625731 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:53.633911 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:53.635232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:53.654609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.570s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:53.655579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:02:53.660160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 4.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:53.660353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:53.660845 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:02:53.678657 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637773.6782546, ed53f547-41ea-4014-a290-8be7d50148aa => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:53.678847 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] VM Started (Lifecycle Event)
May 13 02:02:53.696287 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Releasing lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:53.696762 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Instance network_info: |[{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:53.698702 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Start _get_guest_xml network_info=[{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:53.702530 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:53.702530 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-123586797-2', uuid='e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8'), owner=OwnerMeta(userid='fddb84e700c34bcb911bea020c300727', username='tempest-TestMultiAttachVolumeSwap-17294794-project-member', projectid='a54e73cd5d334cb59d7e916a47e98db7', projectname='tempest-TestMultiAttachVolumeSwap-17294794'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637773.702001) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:53.703196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:53.703691 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:53.706919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:53.707489 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:53.707802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:53.708233 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:53.708653 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:53.712399 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:02:53.713274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:53.715324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:53.718716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:53.738675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c7829434-a8cb-4c6c-a745-1b0c14cc5877 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.845s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:53.748216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-2',id=5,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:53.748677 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:53.750417 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:53.751614 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'pci_devices' on Instance uuid e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:53.771911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-changed-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:53.775492 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing instance network info cache due to event network-changed-b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:53.775839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Acquiring lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:53.775949 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Acquired lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:53.776077 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing network info cache for port b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:53.794201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:53.794594 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:53.830306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk 1073741824" returned: 0 in 0.035s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:53.830895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:53.831396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:53.906502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:53.906886 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:02:53.907112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:53.986022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:53.986722 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Cannot resize image /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:02:53.987131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:02:53.987375 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Ensure instance console log exists: /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:02:53.987760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:53.988085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:53.988301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:54.165682 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:02:54.166117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:02:54.167250 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:54.167250 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:54.185159 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:54.190787 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637774.190419, ed53f547-41ea-4014-a290-8be7d50148aa => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:54.190942 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] VM Paused (Lifecycle Event)
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <uuid>e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8</uuid>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <name>instance-00000005</name>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-123586797-2</nova:name>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:53</nova:creationTime>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:user uuid="fddb84e700c34bcb911bea020c300727">tempest-TestMultiAttachVolumeSwap-17294794-project-member</nova:user>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:project uuid="a54e73cd5d334cb59d7e916a47e98db7">tempest-TestMultiAttachVolumeSwap-17294794</nova:project>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         <nova:port uuid="b954427a-1edc-456a-a562-8652bcf5840e">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="serial">e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="uuid">e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.config"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:06:36:7f"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <target dev="tapb954427a-1e"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/console.log" append="off"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:54.257199 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Preparing to wait for external event network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:54.257199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:54.262350 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-2',id=5,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:54.262350 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:54.262350 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:54.262601 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:54.262601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:54.262601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:54.262716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:54.263509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:54.263663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28763b55-af87-56e6-99c7-1957417c3ec4', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:54.272966 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Successfully updated port: d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:54.275481 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:54.276135 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:54.278264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:54.278550 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb954427a-1e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:54.278903 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb954427a-1e, col_values=(('qos', UUID('e0591b26-16ea-472a-8306-1fde2632ea76')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:54.279089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb954427a-1e, col_values=(('external_ids', {'iface-id': 'b954427a-1edc-456a-a562-8652bcf5840e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:36:7f', 'vm-uuid': 'e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:54.280045 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:54.284698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:54.297159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:54.297669 np0000000663 nova-compute[98103]: INFO os_vif [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e')
May 13 02:02:54.538018 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:54.538018 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:54.538174 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No VIF found with MAC fa:16:3e:cc:d2:47, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:54.538659 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Using config drive
May 13 02:02:54.671869 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:02:54.699240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:54.700977 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:54.705181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:54.781185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:54.781185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquired lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:54.781185 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:02:54.795785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:54.796221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:54.834088 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae7086d52195415d88c31888535909d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f64cf62c02d24c7680e5ac91383a3afb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:02:54.867131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-changed-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:54.870250 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Refreshing instance network info cache due to event network-changed-6865b153-a6fa-487c-8945-9b5ea38fc3d0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:54.870542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] Acquiring lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:54.870641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] Acquired lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:54.870764 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Refreshing network info cache for port 6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:54.882393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:54.885828 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:54.942077 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:54.955186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:54.955691 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.039484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.042358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.062647 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:55.071851 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:55.127845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.128225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.144077 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updated VIF entry in instance network info cache for port b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:02:55.145311 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating instance_info_cache with network_info: [{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:55.203230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.206137 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.218650 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:02:55.229118 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Creating config drive at /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.config
May 13 02:02:55.231990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_tv_95x4 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.260929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_tv_95x4" returned: 0 in 0.029s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.291893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:55.295418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.295612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.371753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.374931 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:55.384142 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:55.385268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:55.420025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.034s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:55.420800 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=14796MB free_disk=74.80452346801758GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:02:55.420962 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:55.421264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:55.426357 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:55.504032 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully created port: 073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:55.648832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Releasing lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:55.650197 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:55.650197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:55.650197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:55.650197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:55.650197 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] No event matching network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e in dict_keys([('network-vif-plugged', 'b954427a-1edc-456a-a562-8652bcf5840e')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:02:55.650406 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f798759c-6b2a-4101-8b4f-76856228509a req-206ad104-6b72-46e1-9f3c-20345f1b1c92 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received unexpected event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e for instance with vm_state building and task_state spawning.
May 13 02:02:55.655037 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:55.756166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:55.785489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:55.831750 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:55.831891 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:55.832023 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No VIF found with MAC fa:16:3e:06:36:7f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:55.832554 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Using config drive
May 13 02:02:55.886166 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:55.892810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:55.905843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Updating instance_info_cache with network_info: [{"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:55.907114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-changed-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:55.908131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Refreshing instance network info cache due to event network-changed-d60ec275-0576-4455-86d9-a06e225c9482. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:55.908881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] Acquiring lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:56.036222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:56.036433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:56.094714 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updated VIF entry in instance network info cache for port 6865b153-a6fa-487c-8945-9b5ea38fc3d0. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:02:56.095027 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating instance_info_cache with network_info: [{"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:56.124490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.132633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.136850 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.159489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.184262 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:02:56.339399 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:56.401324 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully created port: 53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:56.410595 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Releasing lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:56.410860 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Instance network_info: |[{"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:02:56.413286 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Start _get_guest_xml network_info=[{"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:02:56.413416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] Acquired lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:56.413674 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Refreshing network info cache for port d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:56.419614 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:02:56.421242 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-975511766', uuid='6048f565-b022-4a6b-bcc0-64114adab430'), owner=OwnerMeta(userid='40c041c0760e4f5c95781ea71d381e45', username='tempest-VolumesAdminNegativeTest-787831236-project-member', projectid='897c073eaf9e4d5a818c1cf67ccd759a', projectname='tempest-VolumesAdminNegativeTest-787831236'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637776.4208896) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:02:56.422148 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:02:56.422456 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:02:56.423259 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:02:56.423726 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:02:56.424492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:02:56.424770 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:02:56.424966 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:02:56.425167 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:02:56.425335 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:02:56.425505 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:02:56.425658 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:02:56.425868 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:02:56.426029 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:02:56.426219 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:02:56.426481 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:02:56.426598 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:02:56.436643 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-975511766',display_name='tempest-VolumesAdminNegativeTest-server-975511766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesadminnegativetest-server-975511766',id=6,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='897c073eaf9e4d5a818c1cf67ccd759a',ramdisk_id='',reservation_id='r-eo7a4oe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-787831236',owner_user_name='tempest-VolumesAdminNegativeTest-787831236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:53Z,user_data=None,user_id='40c041c0760e4f5c95781ea71d381e45',uuid=6048f565-b022-4a6b-bcc0-64114adab430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:02:56.436865 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converting VIF {"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:56.437520 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:56.438085 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lazy-loading 'pci_devices' on Instance uuid 6048f565-b022-4a6b-bcc0-64114adab430 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:02:56.497975 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Creating config drive at /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.config
May 13 02:02:56.503654 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_pba_pun {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:56.538577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_pba_pun" returned: 0 in 0.035s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:56.541651 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:56.601688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bc6082-af7b-4e7b-9e3e-e0c4743e0da8 req-04aa3854-0f2c-410b-932a-5ac03589507a service nova] Releasing lock "refresh_cache-b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:56.694114 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Booting with volume d06bc804-45a6-4cf1-95a8-0fa453dae250 at /dev/vda
May 13 02:02:56.729726 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637776.729284, a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:56.730035 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] VM Started (Lifecycle Event)
May 13 02:02:56.762691 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:02:56.763145 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpuk4byoug/privsep.sock']
May 13 02:02:56.773337 np0000000663 sudo[110682]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpuk4byoug/privsep.sock
May 13 02:02:56.774157 np0000000663 sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 13 02:02:56.871710 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully created port: efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:56.919185 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:56.945079 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] End _get_guest_xml xml=<domain type="qemu">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <uuid>6048f565-b022-4a6b-bcc0-64114adab430</uuid>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <name>instance-00000006</name>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesAdminNegativeTest-server-975511766</nova:name>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:02:56</nova:creationTime>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:user uuid="40c041c0760e4f5c95781ea71d381e45">tempest-VolumesAdminNegativeTest-787831236-project-member</nova:user>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:project uuid="897c073eaf9e4d5a818c1cf67ccd759a">tempest-VolumesAdminNegativeTest-787831236</nova:project>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         <nova:port uuid="d60ec275-0576-4455-86d9-a06e225c9482">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <system>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="serial">6048f565-b022-4a6b-bcc0-64114adab430</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="uuid">6048f565-b022-4a6b-bcc0-64114adab430</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </system>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <os>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </os>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <features>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </features>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   <devices>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.config"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </disk>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:d3:7b:e7"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <target dev="tapd60ec275-05"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </interface>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/console.log" append="off"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </serial>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <video>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </video>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </rng>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:   </devices>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]: </domain>
May 13 02:02:56.945079 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:02:56.948302 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Preparing to wait for external event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:02:56.948302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:56.948302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:56.948302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:56.948302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-975511766',display_name='tempest-VolumesAdminNegativeTest-server-975511766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesadminnegativetest-server-975511766',id=6,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='897c073eaf9e4d5a818c1cf67ccd759a',ramdisk_id='',reservation_id='r-eo7a4oe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-787831236',owner_user_name='tempest-VolumesAdminNegativeTest-787831236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:53Z,user_data=None,user_id='40c041c0760e4f5c95781ea71d381e45',uuid=6048f565-b022-4a6b-bcc0-64114adab430,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:02:56.948603 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converting VIF {"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:02:56.948603 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:02:56.948603 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:02:56.948953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.949227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:56.949516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:02:56.951046 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.951380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdf78b62-3394-53bb-be9e-63071fc14012', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:56.953060 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.953801 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:56.959436 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.962817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.963004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd60ec275-05, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:56.963330 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd60ec275-05, col_values=(('qos', UUID('77d94654-2fdc-4b24-b4c6-89a56552123b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:56.963484 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd60ec275-05, col_values=(('external_ids', {'iface-id': 'd60ec275-0576-4455-86d9-a06e225c9482', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:7b:e7', 'vm-uuid': '6048f565-b022-4a6b-bcc0-64114adab430'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:02:56.964289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.965299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:02:56.974917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:56.976232 np0000000663 nova-compute[98103]: INFO os_vif [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05')
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2973c226-2c35-4da1-bd21-cddd0fcbbb34 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ed53f547-41ea-4014-a290-8be7d50148aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 6048f565-b022-4a6b-bcc0-64114adab430 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:02:57.026592 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:02:55 up 26 min,  2 users,  load average: 5.10, 2.49, 1.26\n', 'num_instances': '7', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '7', 'num_proj_4b9a7e74db544084a4907abd0f241e8b': '1', 'io_workload': '6', 'num_vm_building': '6', 'num_task_spawning': '5', 'num_proj_a6194cae22b64d2c9601d523690e9ed9': '1', 'num_proj_5bd9cdc95eb54a1fb998d954aad862a2': '1', 'num_proj_a54e73cd5d334cb59d7e916a47e98db7': '2', 'num_proj_897c073eaf9e4d5a818c1cf67ccd759a': '1', 'num_task_networking': '1', 'num_proj_f64cf62c02d24c7680e5ac91383a3afb': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:02:57.045934 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.074063 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.074863 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 13 02:02:57.074863 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:57.074863 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:57.074972 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:57.074972 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:57.075022 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:57.075127 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:57.076284 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:57.076284 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 13 02:02:57.076284 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.151008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:57.185381 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.201464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.207263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:57.233948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:57.239164 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637777.2388575, a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:57.239286 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] VM Paused (Lifecycle Event)
May 13 02:02:57.303758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:57.304484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:57.380112 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully created port: 5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:57.433744 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:57.448669 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 13 02:02:57.448787 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 13 02:02:57.448943 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 13 02:02:57.448987 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:57.449047 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 13 02:02:57.449148 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 13 02:02:57.449809 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 13 02:02:57.449809 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log: 
May 13 02:02:57.449809 np0000000663 nova-compute[98103]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 13 02:02:57.700569 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:02:57.700878 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:02:57.726132 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Updated VIF entry in instance network info cache for port d60ec275-0576-4455-86d9-a06e225c9482. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:02:57.726568 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Updating instance_info_cache with network_info: [{"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:57.734142 np0000000663 sudo[110682]: pam_unix(sudo:session): session closed for user root
May 13 02:02:57.737814 np0000000663 nova-compute[98103]: INFO oslo.privsep.daemon [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Spawned new privsep daemon via rootwrap
May 13 02:02:57.743136 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:57.747213 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:57.808784 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:02:57.894557 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:02:57.894557 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.nvmeof [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 13 02:02:57.919899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:57.945714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:02:57.945714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:02:57.958675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:02:57.960819 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f'] 
May 13 02:02:57.961122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:02:57.961122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:02:57.961701 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== get_connector_properties: return (1198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:02:57.962335 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating existing volume attachment record: c9006b37-f6bb-4ec0-a573-3da559919e0c {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:02:57.976634 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully created port: f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:02:57.987138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5f0d3546-32fb-4626-90f2-991e6831bd71 req-3b030f8f-e446-4eae-8028-bfcd336fe068 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:57.987382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5f0d3546-32fb-4626-90f2-991e6831bd71 req-3b030f8f-e446-4eae-8028-bfcd336fe068 service nova] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:57.988022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5f0d3546-32fb-4626-90f2-991e6831bd71 req-3b030f8f-e446-4eae-8028-bfcd336fe068 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:57.988022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5f0d3546-32fb-4626-90f2-991e6831bd71 req-3b030f8f-e446-4eae-8028-bfcd336fe068 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:57.988022 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5f0d3546-32fb-4626-90f2-991e6831bd71 req-3b030f8f-e446-4eae-8028-bfcd336fe068 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Processing event network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:02:57.988865 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:02:57.999639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:02:58.003075 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance spawned successfully.
May 13 02:02:58.003534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:02:58.009126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:58.009126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:58.009126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:58.009126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:02:58.204178 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:02:58.230978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb510035-056b-405d-8203-4fe388fcc0f1 req-8df122a0-a1d6-42d6-9950-5b95e9b6d488 service nova] Releasing lock "refresh_cache-6048f565-b022-4a6b-bcc0-64114adab430" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:02:58.250156 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:02:58.250400 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637778.2501996, ed53f547-41ea-4014-a290-8be7d50148aa => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:58.250553 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] VM Resumed (Lifecycle Event)
May 13 02:02:58.383498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:02:58.501403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:58.501567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:02:58.501610 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] No VIF found with MAC fa:16:3e:d3:7b:e7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:02:58.502061 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Using config drive
May 13 02:02:58.515255 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Took 12.49 seconds to spawn the instance on the hypervisor.
May 13 02:02:58.526355 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:58.582195 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: 073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:58.640252 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:02:58.640471 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-073d3192-c5b8-4719-a274-cfb77eae1845. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:02:58.640639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:02:58.640728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:02:58.640843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port 073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:02:58.712004 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:02:58.712185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.291s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:58.712678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.563s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:02:58.713434 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.73 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:02:58.715843 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:02:58.716004 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Claim successful on node np0000000663
May 13 02:02:58.753169 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:58.754428 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:02:59.010744 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:59.035377 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Took 19.48 seconds to build instance.
May 13 02:02:59.144812 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:02:59.168151 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Creating config drive at /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.config
May 13 02:02:59.173248 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9eycrnab {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:59.205262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9eycrnab" returned: 0 in 0.032s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:02:59.256909 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637779.2564933, e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:59.257018 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] VM Started (Lifecycle Event)
May 13 02:02:59.262684 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:02:59.445683 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:02:59.537030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e81119d0-b6da-4cf5-b3fa-5b8e5d912f77 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.988s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:02:59.594431 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Booting with volume f9775139-192b-4c7e-bdcc-173782b7561c at /dev/vdb
May 13 02:02:59.658907 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:02:59.674764 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:02:59.682528 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:02:59.696114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:02:59.710202 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:59.723072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:02:59.723676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:02:59.738426 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:59.742007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:02:59.743748 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fed3:7be7'] 
May 13 02:02:59.743857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:02:59.745380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:02:59.745380 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:02:59.745380 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating existing volume attachment record: 75e9a27e-7ebb-48d6-ba0a-955fd326ba7a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:02:59.759946 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:02:59.763637 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637779.762986, e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:02:59.763637 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] VM Paused (Lifecycle Event)
May 13 02:02:59.844996 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:02:59.947779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3502ae4-53af-426f-a987-588fe00975e7 req-30a00ce1-e723-452c-bb82-b053fe6c406c service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:00.037383 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:00.042148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:00.047261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:00.067953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:00.070159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:00.089493 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:00.091808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:00.092116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:00.093066 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:00.094285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] No waiting events found dispatching network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received unexpected event network-vif-plugged-040d625d-14d0-402b-b2da-88af0ae26f43 for instance with vm_state active and task_state None.
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Processing event network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:00.095236 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:00.095715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:00.095715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:00.095715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:00.095715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] No waiting events found dispatching network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:00.095833 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-64dc3e2a-f4ca-40a5-be0d-b762261d7dbf req-d4181a7f-825c-4761-a753-b64b31181067 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received unexpected event network-vif-plugged-b954427a-1edc-456a-a562-8652bcf5840e for instance with vm_state building and task_state spawning.
May 13 02:03:00.096286 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:00.102801 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:00.104734 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Instance spawned successfully.
May 13 02:03:00.105065 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:00.267262 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:00.272235 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637780.2719896, e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:00.272500 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] VM Resumed (Lifecycle Event)
May 13 02:03:00.403791 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:00.403961 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:00.612026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.612026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.612520 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.612684 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.613055 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.613405 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:00.739425 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:00.739614 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-f59acf5c-2430-4923-a19c-85ad17c9c00d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:00.739796 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:00.739928 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:00.740464 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:00.775218 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:00.776565 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:00.815303 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:00.906812 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:01.121349 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Took 10.02 seconds to spawn the instance on the hypervisor.
May 13 02:03:01.121520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:01.242587 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:01.278922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:01.279245 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637781.279024, 6048f565-b022-4a6b-bcc0-64114adab430 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:01.279386 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] VM Started (Lifecycle Event)
May 13 02:03:01.334581 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:01.416161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.704s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:01.417086 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.033s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:01.417328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:03:01.423048 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:03:01.423226 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Claim successful on node np0000000663
May 13 02:03:01.432864 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Booting with volume 31879686-1b3b-4707-9ca0-3c271de030bb at /dev/vdc
May 13 02:03:01.488779 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:01.499394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:01.520845 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:01.522811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:01.551365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:01.551667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:01.560588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:01.562996 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fed3:7be7', 'fe80::a46f:f5ff:fea0:823c'] 
May 13 02:03:01.563167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:01.563251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:01.563603 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:01.563785 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating existing volume attachment record: 32eb3ff8-c7a8-423c-a323-b80109860577 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:01.632066 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Took 20.60 seconds to build instance.
May 13 02:03:01.782532 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:01.789526 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637781.7891405, 6048f565-b022-4a6b-bcc0-64114adab430 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:01.792247 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] VM Paused (Lifecycle Event)
May 13 02:03:01.812690 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: 53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:01.934392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:03:01.934598 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:03:01.934891 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:01.935160 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:01.967693 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:02.023570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9d897c0a-9eaa-4bda-837f-ea041ac95933 req-e99486e3-32c5-4a78-b497-2f5caaf96d96 service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:02.049863 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b7888f9faa44571ba756dfc65e033d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa68ef76ab4ec78cb3d85b6cf5dc57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:03:02.134578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.109s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:02.200126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-changed-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:02.201157 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Refreshing instance network info cache due to event network-changed-040d625d-14d0-402b-b2da-88af0ae26f43. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:02.201513 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] Acquiring lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:02.201577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] Acquired lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:02.202597 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Refreshing network info cache for port 040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:02.294963 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:02.298027 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:02.440985 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:03:02.632261 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Successfully created port: 11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:03:02.705627 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:02.800887 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:02.878626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:02.878626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:02.878626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:02.878626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:02.878853 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:02.947731 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:03:02.967705 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:03.095464 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:03.095742 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:03.103281 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:03.103281 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:03.103598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:03.103598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:03.103706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:03.104777 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6d521614-1cf4-4e12-b226-d97b413d8bd9 req-36f5340c-ee7b-4c47-ab3c-c8799d3df13f service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d for instance with vm_state building and task_state block_device_mapping.
May 13 02:03:03.382926 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:03.504420 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:03.529045 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Successfully updated port: 11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:03.598641 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:03.715183 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:03.730249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:03:03.734777 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:03:03.739839 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Creating image(s)
May 13 02:03:03.742120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:03:03.742120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Ensure instance console log exists: /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:03:03.742120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:03.742120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:03.742120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:03.905670 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:03.963230 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:03:03.964251 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:03:03.964585 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Creating image(s)
May 13 02:03:03.965959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:03.966166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:03.969489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:03.970412 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:03.974322 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:03.975606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:04.037760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:04.037914 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:04.038179 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:03:04.072405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:04.072405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:04.072405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:04.072405 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:04.074701 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:04.075024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:04.116342 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.700s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:04.118536 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:03:04.158621 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updated VIF entry in instance network info cache for port 040d625d-14d0-402b-b2da-88af0ae26f43. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:04.159158 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updating instance_info_cache with network_info: [{"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:04.182854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:04.183474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:04.220136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:04.220805 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:04.222001 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-53755aee-e02b-4634-865f-27868f510ce5. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:04.222001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:04.222001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:04.222001 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port 53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:04.229112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk 1073741824" returned: 0 in 0.045s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:04.232116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:04.232116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:04.288793 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:04.291150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-efb9d48d-84ac-40ba-96c4-a6744a886582. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:04.291657 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:04.320017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:04.320661 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:03:04.322610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:04.406584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:04.406584 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Cannot resize image /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:03:04.408919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:03:04.408919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Ensure instance console log exists: /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:03:04.408919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:04.410635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:04.410635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:04.507696 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: 5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:04.632214 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:03:04.635372 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:03:04.635372 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:04.635372 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:04.652906 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:04.665857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc4f8c96-b669-4fca-b9ca-ee21bf1d7854 req-4e198907-8739-4dd9-bdd6-dfa1f224b255 service nova] Releasing lock "refresh_cache-ed53f547-41ea-4014-a290-8be7d50148aa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:04.725892 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33425a40c04d488bba6393ace2394be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeca98c5180647b2910bdd1f13ac4196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:03:04.731189 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:04.871508 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:04.964542 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:04.979504 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:04.980325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:04.980517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:04.980639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:04.980747 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] No event matching network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 in dict_keys([('network-vif-plugged', 'a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:04.980858 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received unexpected event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 for instance with vm_state building and task_state spawning.
May 13 02:03:04.980957 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:04.981130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:04.981236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:04.981356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:04.981533 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] No event matching network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 in dict_keys([('network-vif-plugged', '772c3f74-65ab-4239-a55b-7ecf08c6bc79')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:04.981692 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received unexpected event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 for instance with vm_state building and task_state spawning.
May 13 02:03:04.981692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-changed-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:04.981804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Refreshing instance network info cache due to event network-changed-11134c0d-5266-455d-9b09-07953c0b92c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:04.981961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:05.073772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:05.138328 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:03:05.176233 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:05.240000 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:05.370909 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Successfully created port: 89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:03:05.560853 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:05.562765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:05.563746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:05.563982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:05.564154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:05.564325 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-831e0688-9b91-4fc3-be4e-676861012ebe req-47e3e49b-1fed-49c6-b943-91753edcea7a service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca for instance with vm_state building and task_state spawning.
May 13 02:03:05.643764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:03:05.651265 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Successfully updated port: f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:05.678620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:05.678870 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance network_info: |[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:03:05.679482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:05.681391 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Refreshing network info cache for port 11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:05.683338 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start _get_guest_xml network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:03:05.689344 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:05.691813 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1897002082', uuid='2973c226-2c35-4da1-bd21-cddd0fcbbb34'), owner=OwnerMeta(userid='7b7888f9faa44571ba756dfc65e033d5', username='tempest-ServerActionsTestOtherB-810999869-project-member', projectid='45aa68ef76ab4ec78cb3d85b6cf5dc57', projectname='tempest-ServerActionsTestOtherB-810999869'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637785.6913877) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:03:05.695081 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:03:05.696391 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:03:05.697352 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:03:05.697600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:03:05.698910 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:03:05.699320 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:03:05.699514 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:03:05.699651 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:03:05.699808 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:03:05.699940 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:03:05.700072 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:03:05.700403 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:03:05.700571 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:03:05.700785 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:03:05.700963 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:03:05.702010 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:03:05.713741 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:05.713993 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:05.714888 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:05.716616 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'pci_devices' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:05.742825 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-822197a7-0838-457c-a069-be1281939044 req-c9e3e8c6-3b16-476f-b0c9-5d8ecee4fe2c service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:05.743229 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:05.743463 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:05.989972 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Successfully updated port: 89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:06.153826 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:06.184678 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:06.220170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] End _get_guest_xml xml=<domain type="qemu">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <uuid>2973c226-2c35-4da1-bd21-cddd0fcbbb34</uuid>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <name>instance-00000008</name>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherB-server-1897002082</nova:name>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:03:05</nova:creationTime>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:user uuid="7b7888f9faa44571ba756dfc65e033d5">tempest-ServerActionsTestOtherB-810999869-project-member</nova:user>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:project uuid="45aa68ef76ab4ec78cb3d85b6cf5dc57">tempest-ServerActionsTestOtherB-810999869</nova:project>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         <nova:port uuid="11134c0d-5266-455d-9b09-07953c0b92c2">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <system>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="serial">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="uuid">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </system>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <os>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </os>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <features>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </features>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   <devices>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:64:87:88"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <target dev="tap11134c0d-52"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/console.log" append="off"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </serial>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <video>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </video>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </rng>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:   </devices>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]: </domain>
May 13 02:03:06.220170 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:03:06.222362 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Preparing to wait for external event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:06.222362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:06.222362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:06.222362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:06.222459 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:06.223445 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:06.223445 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:06.223779 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:06.227721 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.228014 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:06.228292 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:06.230597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.231917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55c3579d-fde6-5298-86c1-521c71b511ee', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:06.232736 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.233429 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:06.234359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.240784 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.241042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11134c0d-52, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:06.241818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11134c0d-52, col_values=(('qos', UUID('315508df-ffb7-4c5a-90df-f0d63df5497a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:06.241818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11134c0d-52, col_values=(('external_ids', {'iface-id': '11134c0d-5266-455d-9b09-07953c0b92c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:87:88', 'vm-uuid': '2973c226-2c35-4da1-bd21-cddd0fcbbb34'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:06.242625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.244103 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:06.245917 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:06.250559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:06.251626 np0000000663 nova-compute[98103]: INFO os_vif [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:03:06.337395 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:06.379808 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:06.379975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:06.380168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:06.492052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:06.495110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:06.495110 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:03:06.552134 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:06.573796 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:06.653632 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:03:06.655266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:03:06.655704 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Creating image(s)
May 13 02:03:06.656371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:06.656729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:06.657429 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:06.661287 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:06.662581 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:06.663933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:06.742532 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updated VIF entry in instance network info cache for port 11134c0d-5266-455d-9b09-07953c0b92c2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:06.743173 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:06.755935 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:06.757430 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:06.758036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:06.761120 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:06.762302 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:06.763487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:06.846112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:06.846623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:06.888150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk 1073741824" returned: 0 in 0.041s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:06.889589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.131s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:06.889589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:06.979403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:06.979853 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:03:06.980189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:07.046765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.066s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:07.047133 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Cannot resize image /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:03:07.047526 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:03:07.047711 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Ensure instance console log exists: /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:03:07.047996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:07.048252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:07.048412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:07.070972 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:07.076459 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d27550cb-b44e-42cd-b515-594c3e4856a7 req-15aedea3-1f91-4f70-b156-d86990ee5bba service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:07.078627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:07.078627 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:03:07.213514 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:07.248708 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:07.248945 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:07.249163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:07.249311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:07.249443 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:07.249571 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Processing event network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:07.249705 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:07.249817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:07.249937 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:07.250032 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:07.250207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] No waiting events found dispatching network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:07.250331 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received unexpected event network-vif-plugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 for instance with vm_state building and task_state spawning.
May 13 02:03:07.250431 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:07.250597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:07.250686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:07.250801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:07.250890 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Processing event network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:07.251022 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:07.251331 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:07.251772 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance event wait completed in 10 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:07.251945 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance event wait completed in 16 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:07.252079 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:07.254366 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637787.2539885, a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:07.254561 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] VM Resumed (Lifecycle Event)
May 13 02:03:07.256231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:07.256715 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:07.259172 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance spawned successfully.
May 13 02:03:07.259172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:07.260589 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance spawned successfully.
May 13 02:03:07.263477 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:07.418592 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:07.652626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-changed-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:07.652886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing instance network info cache due to event network-changed-89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:07.653044 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] Acquiring lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:07.698671 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:07.759617 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:07.767173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.767173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.770461 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.772177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:07.773186 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.773644 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.773991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.783343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.784732 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.786296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.787907 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.788919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.788919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:07.798396 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:07.798396 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:07.798396 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No VIF found with MAC fa:16:3e:64:87:88, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:07.798796 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Using config drive
May 13 02:03:07.924674 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:07.926603 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Instance network_info: |[{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:03:07.926603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] Acquired lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:07.926603 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing network info cache for port 89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:07.929172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Start _get_guest_xml network_info=[{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:03:07.931064 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:07.932295 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-937037352', uuid='ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5'), owner=OwnerMeta(userid='33425a40c04d488bba6393ace2394be5', username='tempest-ServerActionsTestOtherA-1936571963-project-member', projectid='eeca98c5180647b2910bdd1f13ac4196', projectname='tempest-ServerActionsTestOtherA-1936571963'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637787.9318695) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:03:07.933211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:03:07.933493 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:03:07.934284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:03:07.934438 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:03:07.935307 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:03:07.935631 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:03:07.935860 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:03:07.935860 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:03:07.935915 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:03:07.935998 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:03:07.936108 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:03:07.936235 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:03:07.936331 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:03:07.936432 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:03:07.936562 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:03:07.936676 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:03:07.948407 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:07.954434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-937037352',display_name='tempest-ServerActionsTestOtherA-server-937037352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-937037352',id=9,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-vwy6ymr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:07.954734 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:07.955219 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:07.955817 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'pci_devices' on Instance uuid ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:08.280553 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:08.280553 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637788.279181, 90b73edb-7021-4d08-90fe-4cd3f5678c7c => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:08.280553 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] VM Resumed (Lifecycle Event)
May 13 02:03:08.284214 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Took 24.73 seconds to spawn the instance on the hypervisor.
May 13 02:03:08.284361 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:08.293637 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:08.297081 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Took 19.82 seconds to spawn the instance on the hypervisor.
May 13 02:03:08.298464 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:08.307116 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:08.429979 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:08.451857 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Creating config drive at /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config
May 13 02:03:08.456209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj7up7zys {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:08.478967 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] End _get_guest_xml xml=<domain type="qemu">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <uuid>ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5</uuid>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <name>instance-00000009</name>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherA-server-937037352</nova:name>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:03:07</nova:creationTime>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:user uuid="33425a40c04d488bba6393ace2394be5">tempest-ServerActionsTestOtherA-1936571963-project-member</nova:user>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:project uuid="eeca98c5180647b2910bdd1f13ac4196">tempest-ServerActionsTestOtherA-1936571963</nova:project>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         <nova:port uuid="89932177-53f0-4903-bef2-895d215d7444">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <system>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="serial">ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="uuid">ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </system>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <os>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </os>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <features>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </features>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   <devices>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.config"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:02:ba:a6"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <target dev="tap89932177-53"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/console.log" append="off"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </serial>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <video>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </video>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </rng>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:   </devices>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]: </domain>
May 13 02:03:08.478967 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:03:08.481330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Preparing to wait for external event network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:08.481330 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:08.481330 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:08.481330 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:08.481514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-937037352',display_name='tempest-ServerActionsTestOtherA-server-937037352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-937037352',id=9,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-vwy6ymr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:08.481733 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:08.483937 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:08.484886 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:08.487218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.487218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:08.487218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:08.488175 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.489360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429df807-c725-523b-9732-3a134cbd353c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:08.490116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj7up7zys" returned: 0 in 0.034s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:08.503154 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.503154 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:08.507673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.512832 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.513041 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89932177-53, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:08.513497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89932177-53, col_values=(('qos', UUID('10b71923-8a65-41cc-8d39-74e77a37deb2')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:08.513880 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89932177-53, col_values=(('external_ids', {'iface-id': '89932177-53f0-4903-bef2-895d215d7444', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:ba:a6', 'vm-uuid': 'ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:08.514839 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.516065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:08.530179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:08.533395 np0000000663 nova-compute[98103]: INFO os_vif [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53')
May 13 02:03:08.673663 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:08.783875 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:08.788296 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:08.794604 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Took 30.22 seconds to build instance.
May 13 02:03:08.817130 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Took 27.82 seconds to build instance.
May 13 02:03:08.839877 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:09.001353 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.034287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.046058 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:09.051607 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updated VIF entry in instance network info cache for port 89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:09.051926 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:09.141145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.295199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-138a0d1f-a269-41c4-9f8b-36b5e920abee tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.732s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:09.319762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-27932ceb-46a8-4242-b446-ef8bde33532e tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.332s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:09.419082 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.432004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.440503 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.461927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.466895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:09.529733 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:09.555903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50652870-9235-42a8-a2da-c6b945bbaa97 req-f48a4fe2-fb9f-4d6b-a56d-d6cea3ba6574 service nova] Releasing lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:09.914885 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:09.974036 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-changed-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:09.976144 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Refreshing instance network info cache due to event network-changed-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:09.976369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] Acquiring lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:09.977164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] Acquired lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:09.977164 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Refreshing network info cache for port a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:10.034563 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637790.034175, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:10.036271 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Started (Lifecycle Event)
May 13 02:03:10.066847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:10.067028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:10.067230 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:02:ba:a6, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:10.067778 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Using config drive
May 13 02:03:10.073123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:10.252359 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-changed-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:10.252528 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing instance network info cache due to event network-changed-b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:10.252858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] Acquiring lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:10.252858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] Acquired lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:10.252858 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing network info cache for port b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:10.263364 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:10.418724 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:10.484284 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:10.537644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:10.539217 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637790.5388932, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:10.540182 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Paused (Lifecycle Event)
May 13 02:03:10.578793 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:10.756165 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:10.855333 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Creating config drive at /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.config
May 13 02:03:10.862916 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt5z7fo8r {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:10.914071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt5z7fo8r" returned: 0 in 0.050s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:10.920888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:10.921890 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance network_info: |[{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:03:10.927201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:10.930994 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:10.935784 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Start _get_guest_xml network_info=[{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '66b654d9-cad8-4b68-8ce5-30b605e35e0b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'serial': 'd06bc804-45a6-4cf1-95a8-0fa453dae250'}, 'attachment_id': 'c9006b37-f6bb-4ec0-a573-3da559919e0c', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '66b654d9-cad8-4b68-8ce5-30b605e35e0b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'serial': 'f9775139-192b-4c7e-bdcc-173782b7561c'}, 'attachment_id': '75e9a27e-7ebb-48d6-ba0a-955fd326ba7a', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '66b654d9-cad8-4b68-8ce5-30b605e35e0b', 'attached_at': '', 'detached_at': '', 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'serial': '31879686-1b3b-4707-9ca0-3c271de030bb'}, 'attachment_id': '32eb3ff8-c7a8-423c-a323-b80109860577', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:03:10.942420 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:10.945699 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-801908412', uuid='66b654d9-cad8-4b68-8ce5-30b605e35e0b'), owner=OwnerMeta(userid='ae7086d52195415d88c31888535909d4', username='tempest-TaggedBootDevicesTest-1829891618-project-member', projectid='f64cf62c02d24c7680e5ac91383a3afb', projectname='tempest-TaggedBootDevicesTest-1829891618'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637790.9451015) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:03:10.947894 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:03:10.949873 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:03:10.954035 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:03:10.954230 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:03:10.955412 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:03:10.955860 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:03:10.955977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:03:10.956019 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:03:10.956169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:03:10.956279 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:03:10.956348 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:03:10.957346 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:03:10.958139 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:03:10.960526 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:03:10.963713 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:10.963982 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:03:10.964082 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:03:10.982267 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:10.982392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:10.984642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connector [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Factory for ISCSI on None {{(pid=98103) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 13 02:03:10.984702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:10.984879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:10.985377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:10.985521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:10.985896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:10.987193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:10.999185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:10.999816 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:11.000543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:11.000849 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:11.001438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:11.001656 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:11.016767 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:11.016767 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:11.017673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:11.017673 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250] added
May 13 02:03:11.032205 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:11.032205 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:11.032205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:11.032581 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:11.032581 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250] added
May 13 02:03:11.038592 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:11.038592 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0354(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:11.038592 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:11.042629 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:11.049593 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:11.202663 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:11.256402 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updated VIF entry in instance network info cache for port a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:11.256713 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating instance_info_cache with network_info: [{"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:11.377965 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updated VIF entry in instance network info cache for port b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:11.378400 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating instance_info_cache with network_info: [{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:11.437940 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:11.474741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.500322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.554221 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:11.600509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.758560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97a6da23-5a19-4b5f-9854-78a0e1a46497 req-c92a4f95-5ded-4eab-aa46-c0462c915826 service nova] Releasing lock "refresh_cache-90b73edb-7021-4d08-90fe-4cd3f5678c7c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:11.817260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.819354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.822123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.846952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:11.880574 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab6af3ab-4500-4eb8-9d82-a18050fb626b req-7e6710e6-486e-40d0-baa2-a454d1629a6f service nova] Releasing lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:11.986299 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:12.033480 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:12.037814 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:12.054540 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:12.054540 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:12.061798 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:12.061798 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:12.077720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:12.088416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:12.093647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:03:12.093647 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:12.094652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:03:12.094652 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:12.094779 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:03:12.094779 np0000000663 nova-compute[98103]: 
May 13 02:03:12.100234 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.100437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No event matching network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 in dict_keys([('network-vif-plugged', 'd60ec275-0576-4455-86d9-a06e225c9482')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received unexpected event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with vm_state building and task_state spawning.
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:12.102154 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 for instance with vm_state building and task_state spawning.
May 13 02:03:12.102556 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.102556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.102556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.102735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.102735 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:12.102837 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 for instance with vm_state building and task_state spawning.
May 13 02:03:12.102939 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.104266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.105289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.106117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.106426 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Processing event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:12.106744 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.109178 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.109625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.109625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.109755 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:12.111127 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received unexpected event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with vm_state building and task_state spawning.
May 13 02:03:12.111127 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.117271 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:03:12.117271 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:12.117825 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:03:12.117825 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:12.118336 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Instance event wait completed in 11 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:12.119006 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:03:12.119006 np0000000663 nova-compute[98103]: 
May 13 02:03:12.120871 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.121152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.121378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.121576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No event matching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 in dict_keys([('network-vif-plugged', '11134c0d-5266-455d-9b09-07953c0b92c2')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:12.121747 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state building and task_state spawning.
May 13 02:03:12.121902 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.122076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.123410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.123410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.123410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] No event matching network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 in dict_keys([('network-vif-plugged', '89932177-53f0-4903-bef2-895d215d7444')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:12.123410 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received unexpected event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 for instance with vm_state building and task_state spawning.
May 13 02:03:12.123410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:12.124472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:12.124630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:12.125529 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:12.125752 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-759f8818-1a3a-4f5e-b426-9039e98480dc req-1f550cf8-ee4a-4659-b392-f178dda15f5e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Processing event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:12.126444 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:12.128743 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637792.1284018, 6048f565-b022-4a6b-bcc0-64114adab430 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:12.128953 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] VM Resumed (Lifecycle Event)
May 13 02:03:12.130433 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:12.135053 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Instance spawned successfully.
May 13 02:03:12.135366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:12.139537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:12.141546 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance spawned successfully.
May 13 02:03:12.142165 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:12.235226 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updated VIF entry in instance network info cache for port f1b61a3a-75f3-4453-8ca1-c1ae9ca25023. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:12.235714 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:12.633395 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:12.634844 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:12.642917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.643239 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.643759 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.644178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.644552 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.644848 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.653845 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.657073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.657073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.657073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.657073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.657073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:12.739647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-891d5ae4-1fa3-4be8-80be-222cff9e2732 req-3c579761-974e-4c40-afbb-85c2af89c72d service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:12.740166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:12.740625 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port 5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:13.137450 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:13.137963 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637793.1375492, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:13.137963 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Resumed (Lifecycle Event)
May 13 02:03:13.153530 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Took 19.53 seconds to spawn the instance on the hypervisor.
May 13 02:03:13.153664 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:13.159496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.40.100,3260]
May 13 02:03:13.159496 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.40.100,3260] successful.
May 13 02:03:13.159496 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:13.162198 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Took 9.20 seconds to spawn the instance on the hypervisor.
May 13 02:03:13.162369 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:13.170477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.50.100,3260]
May 13 02:03:13.170477 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.50.100,3260] successful.
May 13 02:03:13.170477 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:13.177130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:13.184673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.194863 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.194863 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:13.194863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:13.195260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:13.195260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.204175 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:13.204175 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.203s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:13.204175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:13.205656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:13.205656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:13.216405 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:13.216527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:13.226541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:13.226541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:13.243006 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:13.516974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:13.642518 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:13.645959 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:13.666965 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Took 32.30 seconds to build instance.
May 13 02:03:13.683080 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:13.686306 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Took 16.63 seconds to build instance.
May 13 02:03:13.891612 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updated VIF entry in instance network info cache for port 5ad9866b-a0bf-47d3-b9d0-494bcace2c6d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:13.893405 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:14.002881 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:03:14.151716 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637794.1514204, ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:14.152014 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] VM Started (Lifecycle Event)
May 13 02:03:14.168574 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.807s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.190795 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:14.190983 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:14.191156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:14.191282 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.191793 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:14.191793 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state active and task_state None.
May 13 02:03:14.195125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:14.195401 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:14.195609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:14.195749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.195996 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Processing event network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:14.196832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.160s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.197552 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:14.197552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:14.197552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:14.198129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.198129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] No waiting events found dispatching network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:14.199161 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a87a1914-0f6f-4658-accb-a16562ba3233 req-ca300b24-a015-4402-a2aa-1bb9175f5960 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received unexpected event network-vif-plugged-89932177-53f0-4903-bef2-895d215d7444 for instance with vm_state building and task_state spawning.
May 13 02:03:14.200103 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:14.204642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:14.208895 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Instance spawned successfully.
May 13 02:03:14.209416 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:14.395443 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:14.395708 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:14.395903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:14.396121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:14.396263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.396425 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] No waiting events found dispatching network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:14.396605 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received unexpected event network-vif-plugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 for instance with vm_state building and task_state spawning.
May 13 02:03:14.396732 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:14.396871 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:14.397009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:14.397182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:14.397646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:14.397646 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a0c8e236-eff9-424b-84df-bbc1dff2fa73 req-985b4357-9c78-411c-b494-a94c7ce54b54 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-unplugged-53755aee-e02b-4634-865f-27868f510ce5 for instance with vm_state building and task_state spawning.
May 13 02:03:14.655658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:14.658674 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:14.719072 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:14.719272 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:14.719742 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:14.720387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:14.720387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:14.720730 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:15.028210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Found WWN 3300000002c8db553 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:15.031256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.045s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:15.031256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== connect_volume: return (4045ms) {'type': 'block', 'scsi_wwn': '3300000002c8db553', 'path': '/dev/dm-0', 'multipath_id': '3300000002c8db553'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:15.031256 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002c8db553', 'path': '/dev/dm-0', 'multipath_id': '3300000002c8db553'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:15.084770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:15.163581 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:15.164824 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637795.1636136, ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:15.164824 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] VM Paused (Lifecycle Event)
May 13 02:03:15.226207 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Took 8.57 seconds to spawn the instance on the hypervisor.
May 13 02:03:15.226207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:15.536372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:15.536779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:15.536941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:15.537374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:15.537602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:15.556830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:15.558157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:15.561195 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:15.563922 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:15.564714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:15.565320 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:15.579291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:15.579291 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:15.588639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:15.588639 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:15.597760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c] added
May 13 02:03:15.597760 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:15.597760 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:15.597760 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:15.597760 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:15.597760 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:15.597760 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:15.598010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:15.598275 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:15.598735 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c] added
May 13 02:03:15.606185 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:15.606185 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:15.606185 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0412(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:15.606598 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:15.667795 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:15.672214 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-changed-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:15.672494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Refreshing instance network info cache due to event network-changed-11134c0d-5266-455d-9b09-07953c0b92c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:15.673056 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:15.673505 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:15.673738 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Refreshing network info cache for port 11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:15.678691 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637795.677766, ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:15.678691 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] VM Resumed (Lifecycle Event)
May 13 02:03:15.743061 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Took 17.43 seconds to build instance.
May 13 02:03:16.177233 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:16.184664 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:16.187159 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:16.246127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.942s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:16.527850 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-changed-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:16.529281 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing instance network info cache due to event network-changed-89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:16.529632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] Acquiring lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:16.529632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] Acquired lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:16.529842 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing network info cache for port 89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:16.586694 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:16.598992 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:16.606979 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:16.613923 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:16.613923 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:16.625581 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:16.625581 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.634190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.641910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.650003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.650003 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.650003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:16.650003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.650003 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.650003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:16.659087 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.659087 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.659087 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:16.659535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.659535 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.659535 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:16.679989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.40.100,3260]
May 13 02:03:16.679989 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.40.100,3260] successful.
May 13 02:03:16.679989 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.691872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.702814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.50.100,3260]
May 13 02:03:16.702814 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.50.100,3260] successful.
May 13 02:03:16.702814 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.708920 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.708920 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.708920 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.708920 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.708920 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:16.709198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.709198 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.709198 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.709198 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.709198 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:16.709626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:16.709626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:16.710421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('9', '-', '-', 0) found on session 5 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:16.710561 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:16.717792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:16.733380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 5 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:16.733380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:16.736585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.736585 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.736585 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.736585 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.736585 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:16.736963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.736963 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:16.736963 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.736963 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:16.736963 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:16.737193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:16.737193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:16.738035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('10', '-', '-', 0) found on session 6 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:16.738229 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:16.757919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:16.770383 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updated VIF entry in instance network info cache for port 11134c0d-5266-455d-9b09-07953c0b92c2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:16.770787 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:17.035482 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:17.274016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e88872fa-c7cd-422a-bb77-cb8698eef43a req-122c921b-9a71-4c19-83bb-471db03ae924 service nova] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:17.454227 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:17.511759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:17.511911 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:17.512179 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:17.512355 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:17.512520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:17.516017 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Terminating instance
May 13 02:03:17.639026 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updated VIF entry in instance network info cache for port 89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:17.639771 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:17.759072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 6 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:17.759365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:18.019532 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:03:18.038248 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.044406 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.068368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.080876 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.108257 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.145418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eb30db35-27b0-47ec-a1ef-b9a15e591de2 req-fce38908-ed41-4ede-bd75-018d112b10a6 service nova] Releasing lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:18.371549 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.408416 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.414227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.421376 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99939247999987 future=<Future at 0x705c6c7639e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:18.421376 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997956195999905 future=<Future at 0x705c6c7639e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:18.421376 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997834459999922 future=<Future at 0x705c6c7639e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:18.422759 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Instance destroyed successfully.
May 13 02:03:18.423726 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lazy-loading 'resources' on Instance uuid 6048f565-b022-4a6b-bcc0-64114adab430 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:18.435679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.520163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.590559 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Found WWN 33000000041c6a34c for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:18.590943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:18.593009 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '33000000041c6a34c', 'path': '/dev/dm-3', 'multipath_id': '33000000041c6a34c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:18.593228 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000041c6a34c', 'path': '/dev/dm-3', 'multipath_id': '33000000041c6a34c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:18.657494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:18.657977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:18.658281 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:18.658387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:18.658542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:18.659403 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:18.659846 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:18.660036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:18.660413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:18.660592 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:18.660743 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:18.660902 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb51a707-3e7d-4266-ae30-0254529ea8a0 req-c8aadab8-18f6-4635-9b64-468b6f4d4eaf service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:18.789040 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.802518 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.809070 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.825832 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.830106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.934014 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-975511766',display_name='tempest-VolumesAdminNegativeTest-server-975511766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesadminnegativetest-server-975511766',id=6,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:13Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='897c073eaf9e4d5a818c1cf67ccd759a',ramdisk_id='',reservation_id='r-eo7a4oe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-787831236',owner_user_name='tempest-VolumesAdminNegativeTest-787831236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:13Z,user_data=None,user_id='40c041c0760e4f5c95781ea71d381e45',uuid=6048f565-b022-4a6b-bcc0-64114adab430,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:03:18.934288 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converting VIF {"id": "d60ec275-0576-4455-86d9-a06e225c9482", "address": "fa:16:3e:d3:7b:e7", "network": {"id": "eb71f3ad-fba7-427e-bfbd-bde6eae04321", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-560662345-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "897c073eaf9e4d5a818c1cf67ccd759a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60ec275-05", "ovs_interfaceid": "d60ec275-0576-4455-86d9-a06e225c9482", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:18.935172 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:18.935637 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:03:18.941528 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.941804 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd60ec275-05, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:18.943232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.944232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:18.945713 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.946996 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.947205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77d94654-2fdc-4b24-b4c6-89a56552123b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:18.948687 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:18.950227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.956547 np0000000663 nova-compute[98103]: INFO os_vif [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:7b:e7,bridge_name='br-int',has_traffic_filtering=True,id=d60ec275-0576-4455-86d9-a06e225c9482,network=Network(eb71f3ad-fba7-427e-bfbd-bde6eae04321),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60ec275-05')
May 13 02:03:18.956547 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Deleting instance files /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430_del
May 13 02:03:18.960535 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:18.962846 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Deletion of /opt/stack/data/nova/instances/6048f565-b022-4a6b-bcc0-64114adab430_del complete
May 13 02:03:18.987466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:19.100172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:19.100471 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:19.100614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:19.100944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:19.101212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:19.122114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:19.122958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:19.122958 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:19.126190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:19.126190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:19.126190 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:19.138991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:19.138991 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:19.140920 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:19.140920 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:19.153494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb] added
May 13 02:03:19.153494 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:19.153494 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:19.153494 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:19.153494 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:19.153494 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:19.153494 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:19.153818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:19.153818 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:19.153885 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:19.156181 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb] added
May 13 02:03:19.156181 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:19.156181 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:19.156181 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:19.156181 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:19.156181 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:19.156181 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:19.156425 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:19.156573 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:19.156752 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:19.471247 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Took 1.45 seconds to destroy the instance on the hypervisor.
May 13 02:03:19.472544 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:03:19.472722 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:03:19.472881 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:03:19.473138 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:19.605907 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:20.022113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-580f2b9a-0515-4d07-9320-53c374bb9b9a req-df661621-b499-4551-b24e-efd58403eccd service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-deleted-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:20.022763 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-580f2b9a-0515-4d07-9320-53c374bb9b9a req-df661621-b499-4551-b24e-efd58403eccd service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Neutron deleted interface d60ec275-0576-4455-86d9-a06e225c9482; detaching it from the instance and deleting it from the info cache
May 13 02:03:20.022763 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-580f2b9a-0515-4d07-9320-53c374bb9b9a req-df661621-b499-4551-b24e-efd58403eccd service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:20.087486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:20.154650 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:20.157250 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:20.168882 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:20.168882 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:20.175982 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:20.175982 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.186608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.191930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.201377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.201377 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.201377 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.201377 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.201377 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:20.201667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.201667 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.201667 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.201667 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.201667 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:20.208998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.208998 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.208998 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.208998 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.208998 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:20.209412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.209412 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.209412 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.209412 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.209412 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:20.239711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.40.100,3260]
May 13 02:03:20.239711 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.40.100,3260] successful.
May 13 02:03:20.239711 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.249822 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.250948 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.50.100,3260]
May 13 02:03:20.250948 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.50.100,3260] successful.
May 13 02:03:20.250948 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.269012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.269566 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.269774 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:20.270234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:20.270386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:20.271402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('11', '-', '-', 0) found on session 7 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:20.271602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:20.291059 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:20.291470 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:20.294741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:20.294741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:20.294741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] HCTL ('12', '-', '-', 0) found on session 8 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:20.294741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:20.321252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 8 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:20.321252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:20.445819 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:20.532148 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-580f2b9a-0515-4d07-9320-53c374bb9b9a req-df661621-b499-4551-b24e-efd58403eccd service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Detach interface failed, port_id=d60ec275-0576-4455-86d9-a06e225c9482, reason: Instance 6048f565-b022-4a6b-bcc0-64114adab430 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:03:20.741780 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:20.742217 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:20.743183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:20.743936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:20.744105 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received unexpected event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with vm_state active and task_state deleting.
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received unexpected event network-vif-plugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with vm_state active and task_state deleting.
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:20.746646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:20.747783 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:20.747894 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:20.748108 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:20.748274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Acquiring lock "6048f565-b022-4a6b-bcc0-64114adab430-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:20.748436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:20.748578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] Lock "6048f565-b022-4a6b-bcc0-64114adab430-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:20.748711 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] No waiting events found dispatching network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:20.748841 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3804c82e-6771-450b-bdcf-1eba9894a7cf req-be6c974f-c532-4de4-8c1b-1d356e70bea4 service nova] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Received event network-vif-unplugged-d60ec275-0576-4455-86d9-a06e225c9482 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:20.950709 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Took 1.48 seconds to deallocate network for instance.
May 13 02:03:21.292118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Searching for a device in session 7 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:21.292325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:21.460122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:21.460373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:21.973416 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:21.973919 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:22.140522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Found WWN 33000000047e8d34f for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:22.142125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:22.142125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000047e8d34f', 'path': '/dev/dm-4', 'multipath_id': '33000000047e8d34f'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:22.142125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000047e8d34f', 'path': '/dev/dm-4', 'multipath_id': '33000000047e8d34f'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:22.477411 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:22.645325 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.645603 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.646108 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.646953 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.647144 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.647598 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.648334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.648509 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.648940 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.649657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.649817 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.650246 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.650940 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.651087 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.651572 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.652227 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.652392 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.652816 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.653590 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:22.653816 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:22.654246 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:22.654872 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b654d9-cad8-4b68-8ce5-30b605e35e0b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:22.984982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.525s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.051441 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Deleted allocations for instance 6048f565-b022-4a6b-bcc0-64114adab430
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] End _get_guest_xml xml=<domain type="qemu">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <uuid>66b654d9-cad8-4b68-8ce5-30b605e35e0b</uuid>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <name>instance-00000007</name>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:name>tempest-device-tagging-server-801908412</nova:name>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:03:10</nova:creationTime>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:user uuid="ae7086d52195415d88c31888535909d4">tempest-TaggedBootDevicesTest-1829891618-project-member</nova:user>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:project uuid="f64cf62c02d24c7680e5ac91383a3afb">tempest-TaggedBootDevicesTest-1829891618</nova:project>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="073d3192-c5b8-4719-a274-cfb77eae1845">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="f59acf5c-2430-4923-a19c-85ad17c9c00d">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.156" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.87" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="53755aee-e02b-4634-865f-27868f510ce5">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="efb9d48d-84ac-40ba-96c4-a6744a886582">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.73" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="5ad9866b-a0bf-47d3-b9d0-494bcace2c6d">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         <nova:port uuid="f1b61a3a-75f3-4453-8ca1-c1ae9ca25023">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <system>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="serial">66b654d9-cad8-4b68-8ce5-30b605e35e0b</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="uuid">66b654d9-cad8-4b68-8ce5-30b605e35e0b</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </system>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <os>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </os>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <features>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </features>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   <devices>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/disk.config"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <alias name="ua-d06bc804-45a6-4cf1-95a8-0fa453dae250"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <serial>d06bc804-45a6-4cf1-95a8-0fa453dae250</serial>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <alias name="ua-f9775139-192b-4c7e-bdcc-173782b7561c"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-3"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <serial>f9775139-192b-4c7e-bdcc-173782b7561c</serial>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <alias name="ua-31879686-1b3b-4707-9ca0-3c271de030bb"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="vdc" bus="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <serial>31879686-1b3b-4707-9ca0-3c271de030bb</serial>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:c0:b7:2c"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tap073d3192-c5"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:aa:b3:2f"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tapf59acf5c-24"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:cf:18:a4"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tapff5c373b-bd"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:2e:08:90"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tap53755aee-e0"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:a7:6e:1e"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tapefb9d48d-84"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:03:c6:2c"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tap5ad9866b-a0"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:a3:d3:54"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <target dev="tapf1b61a3a-75"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/console.log" append="off"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </serial>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <video>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </video>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </rng>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:   </devices>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: </domain>
May 13 02:03:23.161520 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.161520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Preparing to wait for external event network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.169599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.173540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cddb8aa7-d4cb-59fc-b60b-ebdc7096270d', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.173540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.173540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.190424 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.190973 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap073d3192-c5, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.192399 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap073d3192-c5, col_values=(('qos', UUID('7c405c4f-b150-430c-a04f-606f245325de')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.192399 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap073d3192-c5, col_values=(('external_ids', {'iface-id': '073d3192-c5b8-4719-a274-cfb77eae1845', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:b7:2c', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.196545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.200912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.205672 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.209735 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5')
May 13 02:03:23.210551 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.210915 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.216087 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.216378 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.217205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.217430 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.217674 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.220688 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.220907 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7eabc199-432c-5c64-ab12-dc5ef4e7a648', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.222301 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.223081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.229806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.237341 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.237561 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf59acf5c-24, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.237849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf59acf5c-24, col_values=(('qos', UUID('39aba0c2-e641-43fa-9645-6c817cb64aa0')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.237998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf59acf5c-24, col_values=(('external_ids', {'iface-id': 'f59acf5c-2430-4923-a19c-85ad17c9c00d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:b3:2f', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.242341 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.243670 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.255016 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.256177 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24')
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.258237 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.258810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.261260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.261413 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37c2af4f-6d8e-588e-9113-294cd308fb05', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.263440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.263440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.282122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.284428 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.284671 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff5c373b-bd, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.284995 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff5c373b-bd, col_values=(('qos', UUID('9f305c91-79e7-411d-87f3-f9b41c82b48f')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.285165 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff5c373b-bd, col_values=(('external_ids', {'iface-id': 'ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:18:a4', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.286254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.287258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.305526 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.307173 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd')
May 13 02:03:23.308696 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.308696 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.308696 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.308995 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.309341 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.309675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.309929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.311151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.311343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '652969b7-5a90-5c66-a8ff-aed4cf3fb84d', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.312155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.313026 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.331965 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.335191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.335191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53755aee-e0, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.335191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53755aee-e0, col_values=(('qos', UUID('c3770f6b-743a-42e3-b236-88db2e19338a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.335191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53755aee-e0, col_values=(('external_ids', {'iface-id': '53755aee-e02b-4634-865f-27868f510ce5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:08:90', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.335661 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.339214 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.366556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.372019 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0')
May 13 02:03:23.373120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.373555 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.374548 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.377819 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.378269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.378524 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.378768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.382357 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.382637 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5f7ed11-78f8-52bb-9dd4-8bd45ce0f612', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.383731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.384711 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.411282 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.414035 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.414741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefb9d48d-84, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.415069 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefb9d48d-84, col_values=(('qos', UUID('ec03f702-cbaa-4aed-8b77-dea8bd1f6b27')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.415242 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefb9d48d-84, col_values=(('external_ids', {'iface-id': 'efb9d48d-84ac-40ba-96c4-a6744a886582', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:6e:1e', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.417178 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.418953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.446447 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.449905 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84')
May 13 02:03:23.451135 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.451307 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.451928 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.452113 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.455160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.455492 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.456327 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.458240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.458679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a771fb75-da24-5d54-b4ef-dd08feca8800', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.462067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.463535 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.494966 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.497825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.498037 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ad9866b-a0, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.498438 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ad9866b-a0, col_values=(('qos', UUID('30c8d510-fbf9-460c-b5b0-1d4930b0fe1c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.498894 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ad9866b-a0, col_values=(('external_ids', {'iface-id': '5ad9866b-a0bf-47d3-b9d0-494bcace2c6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c6:2c', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.500510 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.504185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.533427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.534806 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0')
May 13 02:03:23.535713 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:02:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:23.535861 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:23.536373 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:23.536589 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:23.536831 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.537166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.537448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:23.538732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.538965 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8bc6e280-7a63-504d-9d44-d04be882ff9e', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.539873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.540661 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.572083 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.574991 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.575203 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1b61a3a-75, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.575598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1b61a3a-75, col_values=(('qos', UUID('4b9cebed-f372-4b68-a0ff-b872a8cbe350')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.575800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1b61a3a-75, col_values=(('external_ids', {'iface-id': 'f1b61a3a-75f3-4453-8ca1-c1ae9ca25023', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:d3:54', 'vm-uuid': '66b654d9-cad8-4b68-8ce5-30b605e35e0b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:23.576895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.580640 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:23.619215 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:23.620649 np0000000663 nova-compute[98103]: INFO os_vif [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75')
May 13 02:03:24.063046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7aebb33d-a1f0-4dca-8733-099e4ca8ff11 tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Lock "6048f565-b022-4a6b-bcc0-64114adab430" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.551s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:25.090581 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:25.145255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:25.145605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:25.145743 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] No VIF found with MAC fa:16:3e:c0:b7:2c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:25.146071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] No VIF found with MAC fa:16:3e:a7:6e:1e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:25.146795 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Using config drive
May 13 02:03:25.655987 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:25.878831 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Creating config drive at /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/disk.config
May 13 02:03:25.883951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7fcpk4n {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:25.944873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7fcpk4n" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:26.285294 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.463306 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.521331 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.620451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.755044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.763362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.849986 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.924719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.932822 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-091b376e-b492-4873-9933-09c3e48600ea req-4fab697d-44c3-47f9-bc87-8c8fd49ca389 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:26.933156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-091b376e-b492-4873-9933-09c3e48600ea req-4fab697d-44c3-47f9-bc87-8c8fd49ca389 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:26.938902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-091b376e-b492-4873-9933-09c3e48600ea req-4fab697d-44c3-47f9-bc87-8c8fd49ca389 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:26.938902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:26.942424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-091b376e-b492-4873-9933-09c3e48600ea req-4fab697d-44c3-47f9-bc87-8c8fd49ca389 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:26.942424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-091b376e-b492-4873-9933-09c3e48600ea req-4fab697d-44c3-47f9-bc87-8c8fd49ca389 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:26.981950 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.008374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.014900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.052757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.073505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.119827 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.203717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.249046 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.251807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.405247 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.414670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7f61cfe4-1359-4ce7-8046-84e632fc3436 req-fcd1d1be-a011-40b0-afea-87cda6dfeee8 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:27.414670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7f61cfe4-1359-4ce7-8046-84e632fc3436 req-fcd1d1be-a011-40b0-afea-87cda6dfeee8 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:27.416578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7f61cfe4-1359-4ce7-8046-84e632fc3436 req-fcd1d1be-a011-40b0-afea-87cda6dfeee8 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:27.422532 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7f61cfe4-1359-4ce7-8046-84e632fc3436 req-fcd1d1be-a011-40b0-afea-87cda6dfeee8 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:27.424769 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7f61cfe4-1359-4ce7-8046-84e632fc3436 req-fcd1d1be-a011-40b0-afea-87cda6dfeee8 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:27.486148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.494316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.494476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.597493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.606441 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.644342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.718318 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.722872 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.756794 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.793140 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:27.801423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-10000f1d-e5bc-438a-a43c-2d00b6b5aa9a req-78fb92ed-7b1d-4af4-9b54-b8cf8be20e85 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:27.801702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-10000f1d-e5bc-438a-a43c-2d00b6b5aa9a req-78fb92ed-7b1d-4af4-9b54-b8cf8be20e85 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:27.801963 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-10000f1d-e5bc-438a-a43c-2d00b6b5aa9a req-78fb92ed-7b1d-4af4-9b54-b8cf8be20e85 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:27.802202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-10000f1d-e5bc-438a-a43c-2d00b6b5aa9a req-78fb92ed-7b1d-4af4-9b54-b8cf8be20e85 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:27.802370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-10000f1d-e5bc-438a-a43c-2d00b6b5aa9a req-78fb92ed-7b1d-4af4-9b54-b8cf8be20e85 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:28.046447 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.219268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.219268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.397422 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.398812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.579699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.798545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.807432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.830676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:28.861911 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637808.8613794, 66b654d9-cad8-4b68-8ce5-30b605e35e0b => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:28.862409 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] VM Started (Lifecycle Event)
May 13 02:03:29.058889 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.059127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 in dict_keys([('network-vif-plugged', 'f59acf5c-2430-4923-a19c-85ad17c9c00d'), ('network-vif-plugged', 'ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca'), ('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582'), ('network-vif-plugged', 'f1b61a3a-75f3-4453-8ca1-c1ae9ca25023')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-073d3192-c5b8-4719-a274-cfb77eae1845 for instance with vm_state building and task_state spawning.
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.061181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d in dict_keys([('network-vif-plugged', 'ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca'), ('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582'), ('network-vif-plugged', 'f1b61a3a-75f3-4453-8ca1-c1ae9ca25023')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-f59acf5c-2430-4923-a19c-85ad17c9c00d for instance with vm_state building and task_state spawning.
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.061917 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b88072f5-b8b7-4879-bcfc-6c591c04b9ba req-90701abb-b386-4430-8350-61520c87099d service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:29.123200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:29.124224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:29.365923 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:29.369086 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637809.3687356, 66b654d9-cad8-4b68-8ce5-30b605e35e0b => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:29.369257 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] VM Paused (Lifecycle Event)
May 13 02:03:29.535926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.535926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.535926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.535926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.535926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 in dict_keys([('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582'), ('network-vif-plugged', 'f1b61a3a-75f3-4453-8ca1-c1ae9ca25023')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:29.536173 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-4b086db8-d049-4a0b-ba6c-3c00636c7abd req-62c53366-171d-4881-ab6c-5fce63849fb0 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-53755aee-e02b-4634-865f-27868f510ce5 for instance with vm_state building and task_state spawning.
May 13 02:03:29.871658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:29.873907 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:29.895382 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.895565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.895767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.895954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.896176 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d in dict_keys([('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582'), ('network-vif-plugged', 'f1b61a3a-75f3-4453-8ca1-c1ae9ca25023')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:29.897305 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d for instance with vm_state building and task_state spawning.
May 13 02:03:29.897618 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.897843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.898124 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.898348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.898550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:29.898901 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:29.899197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:29.899764 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:29.899911 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:29.900297 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 in dict_keys([('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:29.900515 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-12aa8038-c255-4dfd-9180-86906f28b4c5 req-32557d8e-e8bb-4102-a736-9b7381eef626 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 for instance with vm_state building and task_state spawning.
May 13 02:03:30.096224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:30.214186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:30.378320 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:31.152540 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:31.153071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:31.153071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:31.153071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:31.153306 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No event matching network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca in dict_keys([('network-vif-plugged', 'efb9d48d-84ac-40ba-96c4-a6744a886582')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:03:31.153364 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca for instance with vm_state building and task_state spawning.
May 13 02:03:31.154245 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:31.154245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:31.154245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:31.154245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:31.154493 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Processing event network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:31.154493 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-55d6c961-385a-4874-8a26-b67017517739 req-be4bc4d7-1b21-4aa8-a763-befd8715a76e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received unexpected event network-vif-plugged-efb9d48d-84ac-40ba-96c4-a6744a886582 for instance with vm_state building and task_state spawning.
May 13 02:03:31.157118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:31.158765 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637811.1583395, 66b654d9-cad8-4b68-8ce5-30b605e35e0b => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:31.158993 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] VM Resumed (Lifecycle Event)
May 13 02:03:31.162673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:31.166905 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance spawned successfully.
May 13 02:03:31.167511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:31.661812 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:31.664904 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:31.679080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:31.679266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:31.679757 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:31.680159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:31.680583 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:31.681198 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:32.167984 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:32.192530 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Took 28.46 seconds to spawn the instance on the hypervisor.
May 13 02:03:32.192530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:32.291847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:32.291847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:32.711681 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Took 45.15 seconds to build instance.
May 13 02:03:32.798137 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:33.036255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:33.219694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.690s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:33.415906 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00041395300013391534 future=<Future at 0x705c6c7639e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:33.416009 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:33.416781 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] Emitting event <LifecycleEvent: 1778637798.4153967, 6048f565-b022-4a6b-bcc0-64114adab430 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:33.416953 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] VM Stopped (Lifecycle Event)
May 13 02:03:33.493078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-changed-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:33.493283 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing instance network info cache due to event network-changed-b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:33.493399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] Acquiring lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:33.493546 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] Acquired lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:33.493690 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Refreshing network info cache for port b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:33.579397 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:33.807437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:33.920109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a9cddd5c-69c7-49d0-a91e-2fb4c52b021b tempest-VolumesAdminNegativeTest-787831236 tempest-VolumesAdminNegativeTest-787831236-project-member] [instance: 6048f565-b022-4a6b-bcc0-64114adab430] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:33.996885 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:34.429319 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:34.595843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updated VIF entry in instance network info cache for port b954427a-1edc-456a-a562-8652bcf5840e. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:34.596074 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating instance_info_cache with network_info: [{"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:35.099917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15a30eac-b0c9-4ba6-ac69-76a443407c09 req-fb8f7606-532f-4407-9717-010bff152db5 service nova] Releasing lock "refresh_cache-e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:35.100368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:35.603278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-changed-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:35.604268 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Refreshing instance network info cache due to event network-changed-772c3f74-65ab-4239-a55b-7ecf08c6bc79. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:35.606657 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Acquiring lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:35.606657 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Acquired lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:35.606657 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Refreshing network info cache for port 772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:35.775575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:35.777031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:35.777031 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Attaching volume db16316f-1893-48fc-aa65-daa691756182 to /dev/vdb
May 13 02:03:35.832065 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:35.843109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:35.870345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:35.897922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:35.898280 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:35.907508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:35.910578 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:35.910772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:35.910918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:35.911877 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:35.912816 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating existing volume attachment record: cd39f49c-7c2b-4ea4-974a-7aff3f8bd4a7 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:36.108329 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:36.506646 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:36.506977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:36.508000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:36.508000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:36.508000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:36.520983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:36.521636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:36.522063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:36.522642 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:36.523176 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:36.525879 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:36.534358 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:36.534358 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:36.543450 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:36.543450 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:36.549384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182] added
May 13 02:03:36.549384 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:36.549384 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:36.549384 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:36.549384 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:36.549384 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:36.549384 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:36.549716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:36.553130 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:36.553130 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:36.557218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182] added
May 13 02:03:36.557218 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:36.557218 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:36.557218 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:36.557218 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:36.557218 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:36.557218 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:36.557494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:36.557586 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:36.557796 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:36.590943 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:36.793294 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updated VIF entry in instance network info cache for port 772c3f74-65ab-4239-a55b-7ecf08c6bc79. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:36.793853 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updating instance_info_cache with network_info: [{"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:37.296500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Releasing lock "refresh_cache-a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:37.296741 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-changed-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:37.296946 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing instance network info cache due to event network-changed-073d3192-c5b8-4719-a274-cfb77eae1845. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:37.297025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Acquiring lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:37.297136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Acquired lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:37.297248 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Refreshing network info cache for port 073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:37.550543 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:37.558369 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:37.565955 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:37.565955 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:37.573169 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:37.573169 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.580909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.586933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.595608 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.595871 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.601865 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.602110 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:37.643080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.50.100,3260]
May 13 02:03:37.643080 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.50.100,3260] successful.
May 13 02:03:37.643080 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.648706 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.40.100,3260]
May 13 02:03:37.648706 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.40.100,3260] successful.
May 13 02:03:37.648706 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.657044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.662213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.678826 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679426 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679654 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:37.679913 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:37.680201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:37.680487 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:37.680654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:37.680856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:37.682506 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('14', '-', '-', 0) found on session 10 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:37.682628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:37.684986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('13', '-', '-', 0) found on session 9 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:37.684986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:37.707640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 10 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:37.707640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:37.707640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 9 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:37.707640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:37.800531 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:38.222670 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:38.369222 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updated VIF entry in instance network info cache for port 073d3192-c5b8-4719-a274-cfb77eae1845. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:03:38.369753 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:38.499031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:38.499222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:38.522674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:03:38.581842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:38.871913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-378ce428-1fc6-4dff-8e84-da46795fdeda req-43458ba7-e3be-44b2-a7d4-785487d4048c service nova] Releasing lock "refresh_cache-66b654d9-cad8-4b68-8ce5-30b605e35e0b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:39.003067 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lazy-loading 'flavor' on Instance uuid ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:39.541139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found WWN 330000000c292b99f for multipath device dm-5 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:39.541485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:39.541720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000c292b99f', 'path': '/dev/dm-5', 'multipath_id': '330000000c292b99f'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:39.541877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c292b99f', 'path': '/dev/dm-5', 'multipath_id': '330000000c292b99f'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:39.543952 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:40.012974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:40.047150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Attempting to attach volume db16316f-1893-48fc-aa65-daa691756182 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:03:40.048994 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:   <alias name="ua-db16316f-1893-48fc-aa65-daa691756182"/>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-5"/>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:   <serial>db16316f-1893-48fc-aa65-daa691756182</serial>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:40.048994 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:03:40.104982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:41.139280 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:41.487753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:41.490290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:41.490290 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Attaching volume e6c1591f-d3be-4cc1-8eac-0a67ee17903d to /dev/sdc
May 13 02:03:41.570802 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:41.586701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:41.614581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:41.649532 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:41.650486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:41.660594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:41.663303 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:41.663666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:41.663936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:41.664542 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:41.664818 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updating existing volume attachment record: d6a9ee0c-b611-4eb3-bb49-13b56ef400e2 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:41.731103 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:41.731272 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:41.731436 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:41.731599 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:7d:c5:f9, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:42.019478 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:42.019783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:42.244105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:42.244629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:42.244743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:42.245014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:42.245232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:42.261109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:42.262578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:42.263696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:42.263696 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:42.264018 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:42.264279 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:42.278545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:42.278545 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:42.283413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:42.283413 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:42.289594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d] added
May 13 02:03:42.289594 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:42.289594 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:42.289594 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:42.289594 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:42.289594 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:42.289594 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:42.289757 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:42.289994 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:42.289994 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:42.294933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d] added
May 13 02:03:42.294933 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:42.294933 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:42.294933 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:42.294933 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:42.294933 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:42.294933 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:42.296174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:42.296174 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:42.296174 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:42.527854 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:42.986683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:43.290492 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:43.298129 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:43.305478 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:43.305478 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.312073 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bab20d31-41bd-4080-92da-1bc8e123ade6 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.535s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:43.319518 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:43.319518 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.330119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.337470 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.354534 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.355162 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.364196 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:43.414231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.50.100,3260]
May 13 02:03:43.414231 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.50.100,3260] successful.
May 13 02:03:43.414231 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.425375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.40.100,3260]
May 13 02:03:43.425375 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.40.100,3260] successful.
May 13 02:03:43.425375 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.436926 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.444527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.461206 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.462352 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:43.462352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:43.463943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] HCTL ('15', '-', '-', 0) found on session 11 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:43.464107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:43.466452 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:43.466452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:43.468533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] HCTL ('16', '-', '-', 0) found on session 12 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:43.468995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:43.500994 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:43.501658 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Searching for a device in session 12 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:43.501749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:43.535236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:43.583787 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:44.489922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Searching for a device in session 11 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:44.490560 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:45.107569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:45.130423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:45.130757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:45.131004 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Attaching volume 7f44f074-4f09-468d-a85f-2e778769adcf to /dev/vdb
May 13 02:03:45.185198 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:45.198133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:45.225857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:45.258007 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:45.258514 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:45.270501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:45.272263 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:45.272391 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:45.272554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:45.272731 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:45.272996 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updating existing volume attachment record: c3bdc4e3-da54-4e92-83b8-4f48dec684eb {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:45.286784 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Found WWN 330000000038ec541 for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:45.287234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:45.287832 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000038ec541', 'path': '/dev/dm-6', 'multipath_id': '330000000038ec541'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:45.288017 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000038ec541', 'path': '/dev/dm-6', 'multipath_id': '330000000038ec541'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:45.296664 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lazy-loading 'flavor' on Instance uuid ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:45.802880 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <alias name="ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d"/>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <target dev="sdc" bus="scsi"/>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <serial>e6c1591f-d3be-4cc1-8eac-0a67ee17903d</serial>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:   <address type="drive" controller="0" unit="2"/>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:45.802880 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:03:45.844665 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:45.844952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:45.845073 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:45.845501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:45.845691 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:45.864646 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:45.865434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:45.865692 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:45.867125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:45.867410 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:45.867785 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:45.881773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:45.881773 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:45.888804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:45.888804 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:45.900608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf] added
May 13 02:03:45.900608 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:45.900608 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:45.900608 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:45.900608 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:45.900608 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:45.900608 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:45.900998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:45.900998 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:45.900998 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:45.902742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf] added
May 13 02:03:45.902742 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:45.902742 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:45.902742 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:45.902742 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:45.902742 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:45.902742 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:45.903119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:45.903284 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:45.903417 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:45.999168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:45.999168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:46.166743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:46.167302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:46.282567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:46.282990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:46.502372 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:03:46.672188 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:03:46.786342 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lazy-loading 'flavor' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:46.901496 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:46.903788 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:46.915188 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:46.915188 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:46.921594 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:46.921594 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:46.928574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:46.937639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.949528 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.950200 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.955725 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:46.956077 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:47.001722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.40.100,3260]
May 13 02:03:47.001722 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.40.100,3260] successful.
May 13 02:03:47.001722 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:47.017159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.50.100,3260]
May 13 02:03:47.017159 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.50.100,3260] successful.
May 13 02:03:47.017159 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:47.017801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:47.028713 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.043408 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] HCTL ('17', '-', '-', 0) found on session 13 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:47.043408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.055349 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:47.056503 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:47.057004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:47.057004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:47.058112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] HCTL ('18', '-', '-', 0) found on session 14 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:47.058296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:47.065933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching for a device in session 13 and hctl ['17', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:47.083762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:47.083903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:47.090480 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:03:47.090480 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Claim successful on node np0000000663
May 13 02:03:47.091348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching for a device in session 14 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:47.091935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:47.244535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:47.538027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No BDM found with device name sda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:47.538202 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:47.538372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:47.538451 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] No VIF found with MAC fa:16:3e:ec:a9:ef, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:47.791853 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:48.066660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching for a device in session 13 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:48.066660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:48.586354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:48.678936 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:48.678936 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:48.888884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found WWN 330000000ae1c0756 for multipath device dm-7 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:48.888884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:48.889071 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000ae1c0756', 'path': '/dev/dm-7', 'multipath_id': '330000000ae1c0756'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:48.889143 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ae1c0756', 'path': '/dev/dm-7', 'multipath_id': '330000000ae1c0756'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:48.891803 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:48.995207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:48.995406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:48.995704 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Attaching volume 84a3e029-be6d-45ff-b87d-db0b51ddfadf to /dev/vdb
May 13 02:03:49.045326 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:49.059055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:49.080783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:49.103072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad4d9188-0560-4116-b3ea-c53fadfda457 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.614s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:49.107588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:49.107910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:49.120572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:49.122228 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:49.122418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:49.122418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:49.122695 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:49.122939 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating existing volume attachment record: b99264f9-c6cf-42b8-982b-b0c64034a88f {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:49.184510 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:49.395795 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Attempting to attach volume 7f44f074-4f09-468d-a85f-2e778769adcf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:03:49.396936 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:49.396936 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:03:49.667109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:49.667447 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:49.694123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.608s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:49.694123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:03:49.695595 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.451s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:49.702344 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:03:49.702572 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Claim successful on node np0000000663
May 13 02:03:49.707902 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:49.708337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:49.708552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:49.709054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:49.709351 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:49.725272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:49.727964 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:49.728446 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:49.728752 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:49.729253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:49.729395 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:49.741868 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:49.741868 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:49.750185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:49.750185 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:49.755247 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf] added
May 13 02:03:49.755247 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:49.755247 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:49.755247 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:49.755247 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:49.755247 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:49.755247 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:49.755615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:49.755615 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:49.755765 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:49.764304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf] added
May 13 02:03:49.764304 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:49.764304 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:49.764304 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:49.764304 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:49.764304 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:49.764304 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:49.764602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:49.764602 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:49.764781 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:50.107258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:50.170350 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Detaching volume e6c1591f-d3be-4cc1-8eac-0a67ee17903d
May 13 02:03:50.200683 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:03:50.200885 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:03:50.201225 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:50.201544 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:50.221655 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Attempting to driver detach volume e6c1591f-d3be-4cc1-8eac-0a67ee17903d from mountpoint /dev/sdc
May 13 02:03:50.226521 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Found disk sdc by alias ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:03:50.229879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Found disk sdc by alias ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:03:50.229879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Attempting to detach device sdc from instance ed53f547-41ea-4014-a290-8be7d50148aa from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:03:50.229879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <alias name="ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d"/>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <target dev="sdc" bus="scsi"/>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <serial>e6c1591f-d3be-4cc1-8eac-0a67ee17903d</serial>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:50.229879 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:03:50.239560 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Successfully detached device sdc from instance ed53f547-41ea-4014-a290-8be7d50148aa from the persistent domain config.
May 13 02:03:50.239932 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] (1/8): Attempting to detach device sdc with device alias ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d from instance ed53f547-41ea-4014-a290-8be7d50148aa from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:03:50.242782 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <alias name="ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d"/>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <target dev="sdc" bus="scsi"/>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <serial>e6c1591f-d3be-4cc1-8eac-0a67ee17903d</serial>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:50.242782 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:03:50.320192 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7be413eb9340d1af627622a3e917fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32377a41c4fc4e2781fdff3229fc3395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:03:50.410663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637830.409634, ed53f547-41ea-4014-a290-8be7d50148aa => ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:03:50.412349 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-e6c1591f-d3be-4cc1-8eac-0a67ee17903d for instance ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:03:50.415997 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Successfully detached device sdc from instance ed53f547-41ea-4014-a290-8be7d50148aa from the live domain config.
May 13 02:03:50.416875 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:03:50.417213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:50.417435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:50.704242 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:03:50.756350 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:50.765193 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:50.784725 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Successfully created port: 2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:50.787725 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:50.787725 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:50.790085 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:50.790085 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.800699 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.805198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.818408 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.818749 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.832200 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.832588 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:50.867665 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.40.100,3260]
May 13 02:03:50.867665 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.40.100,3260] successful.
May 13 02:03:50.867665 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.880905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.892600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.50.100,3260]
May 13 02:03:50.892600 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.50.100,3260] successful.
May 13 02:03:50.892600 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.903730 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.904081 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:50.904344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:50.904502 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:50.904966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:50.906967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] HCTL ('19', '-', '-', 0) found on session 15 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:50.907102 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.926229 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:50.928592 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:50.928592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:50.929691 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Searching for a device in session 15 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:50.929899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:50.932956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] HCTL ('20', '-', '-', 0) found on session 16 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:50.932956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Scanning host 20 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:50.947449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Searching for a device in session 16 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:50.947449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:51.065446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:51.065612 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:51.065749 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:51.066181 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No VIF found with MAC fa:16:3e:cc:d2:47, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:51.208274 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:03:51.385527 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:51.385741 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:51.413332 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Successfully updated port: 2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:51.460223 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-changed-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:51.460359 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Refreshing instance network info cache due to event network-changed-2cf28677-2d9d-48a5-a0ac-4396d32381c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:51.460533 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] Acquiring lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:51.460626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] Acquired lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:51.460746 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Refreshing network info cache for port 2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:51.729082 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:03:51.889232 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:51.915892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:51.962847 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:52.050072 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:52.212286 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:52.217817 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:03:52.219310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:03:52.219651 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Creating image(s)
May 13 02:03:52.220219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:52.220485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:52.221119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:52.221746 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:52.225450 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:52.226778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:52.306896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:52.308422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:52.309487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:52.310044 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:52.320156 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:52.320156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:52.394117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:52.394689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:52.407348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.711s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:52.409066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:03:52.438331 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk 1073741824" returned: 0 in 0.043s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:52.438767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.129s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:52.439209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:52.474135 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:52.474655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:52.521839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:52.522302 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:03:52.522611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:52.595011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:52.595448 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:03:52.595938 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:03:52.596194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:03:52.596530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:52.596827 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:52.597054 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:52.633605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-061efa2c-65dc-41e7-a777-0790e178752f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.503s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:52.714689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a46cd7c-319c-49ff-aefd-8efc29c9203f req-a2ee2185-f6d4-4381-92cc-84a52cbb9094 service nova] Releasing lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:52.715162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:52.715319 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:03:52.742918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Found WWN 33000000072ddb2c3 for multipath device dm-8 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:52.743333 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:52.743553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000072ddb2c3', 'path': '/dev/dm-8', 'multipath_id': '33000000072ddb2c3'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:52.743718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000072ddb2c3', 'path': '/dev/dm-8', 'multipath_id': '33000000072ddb2c3'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:52.744546 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.327s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:52.745024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:03:52.745198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:03:52.746899 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lazy-loading 'flavor' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:52.774286 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:52.774723 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:52.774723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:03:52.775015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', '12')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:03:52.776582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d', '11')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:03:52.778110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c75dee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'): ({'sdj'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:03:52.778387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:03:52.778688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Flush multipath device 330000000038ec541 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:03:52.809990 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:03:52.853695 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:03:52.912003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:03:52.912254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:03:52.914753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:03:52.920329 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:03:52.920329 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:03:52.920329 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:52.920329 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:52.929373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:03:52.929625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:03:52.943327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:52.978363 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:52.992948 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.40.100,3260]
May 13 02:03:52.992948 np0000000663 nova-compute[98103]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.40.100,3260] successful.
May 13 02:03:52.992948 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:53.004037 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff4dd8b153c4ae98a37ba022bb538c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9a7e74db544084a4907abd0f241e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:03:53.012328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:53.028439 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:53.075006 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.50.100,3260]
May 13 02:03:53.075006 np0000000663 nova-compute[98103]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-e6c1591f-d3be-4cc1-8eac-0a67ee17903d, portal: 192.168.50.100,3260] successful.
May 13 02:03:53.075006 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:53.110337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:53.110587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:53.110761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] <== disconnect_volume: return (2693ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:53.110935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:03:53.249956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Attempting to attach volume 84a3e029-be6d-45ff-b87d-db0b51ddfadf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:03:53.253800 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] attach device xml: <disk type="block" device="disk">
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:   <alias name="ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf"/>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:   <serial>84a3e029-be6d-45ff-b87d-db0b51ddfadf</serial>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:53.253800 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:03:53.321277 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:53.424010 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:03:53.591892 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:53.595106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:53.618312 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Successfully created port: df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:03:53.841606 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lazy-loading 'flavor' on Instance uuid ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:53.854233 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Updating instance_info_cache with network_info: [{"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:53.931299 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:03:53.983456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:54.038477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:54.038640 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:54.151224 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Successfully updated port: df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:03:54.212420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-changed-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:54.212826 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Refreshing instance network info cache due to event network-changed-df9aaa56-b5c8-4e32-856f-e44e6e3110e2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:03:54.213079 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] Acquiring lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:54.213325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] Acquired lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:54.213382 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Refreshing network info cache for port df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:03:54.354977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-1a8c3497-e0fe-475c-ad89-fccdb35ab740" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:54.355505 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance network_info: |[{"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:03:54.356677 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Start _get_guest_xml network_info=[{"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:03:54.358529 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:54.359667 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1123421912', uuid='1a8c3497-e0fe-475c-ad89-fccdb35ab740'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637834.3593311) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:03:54.361106 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:03:54.361448 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:03:54.363112 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:03:54.363361 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:03:54.364688 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:03:54.364995 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:03:54.365308 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:03:54.365406 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:03:54.365567 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:03:54.365649 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:03:54.365737 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:03:54.365874 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:03:54.365969 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:03:54.366084 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:03:54.366227 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:03:54.366339 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:03:54.380757 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1123421912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1123421912',id=10,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-s2m2p73e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:51Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=1a8c3497-e0fe-475c-ad89-fccdb35ab740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:54.381012 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:54.383464 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:54.384224 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a8c3497-e0fe-475c-ad89-fccdb35ab740 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:54.445491 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.445982 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.446338 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.446537 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.446716 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.446888 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.447162 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.447543 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.447543 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:03:54.449015 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:03:54.541923 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'flavor' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:54.653055 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:03:54.715551 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:54.778296 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:54.850153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ee3636b4-29b3-4905-84e1-6ef465251473 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:54.887617 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] End _get_guest_xml xml=<domain type="qemu">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <uuid>1a8c3497-e0fe-475c-ad89-fccdb35ab740</uuid>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <name>instance-0000000a</name>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1123421912</nova:name>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:03:54</nova:creationTime>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         <nova:port uuid="2cf28677-2d9d-48a5-a0ac-4396d32381c2">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <system>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="serial">1a8c3497-e0fe-475c-ad89-fccdb35ab740</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="uuid">1a8c3497-e0fe-475c-ad89-fccdb35ab740</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </system>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <os>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </os>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <features>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </features>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   <devices>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.config"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:41:4e:0e"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <target dev="tap2cf28677-2d"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/console.log" append="off"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </serial>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <video>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </video>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </rng>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:   </devices>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]: </domain>
May 13 02:03:54.887617 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Preparing to wait for external event network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1123421912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1123421912',id=10,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-s2m2p73e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:51Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=1a8c3497-e0fe-475c-ad89-fccdb35ab740,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:54.889630 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:54.889960 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:54.890165 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:54.890644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.890871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:54.891326 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:54.892679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.893348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b94bc1a-d232-5ace-994a-12fdf66a6663', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:54.893940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.895133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:54.895971 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.898534 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.898724 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf28677-2d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:54.899084 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cf28677-2d, col_values=(('qos', UUID('52a6990f-349a-4e52-a302-c65677b98c08')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:54.899283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cf28677-2d, col_values=(('external_ids', {'iface-id': '2cf28677-2d9d-48a5-a0ac-4396d32381c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:4e:0e', 'vm-uuid': '1a8c3497-e0fe-475c-ad89-fccdb35ab740'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:54.900065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.901135 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:54.908342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:54.909268 np0000000663 nova-compute[98103]: INFO os_vif [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d')
May 13 02:03:54.912320 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:54.939117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:03:54.939117 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:03:54.939117 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Creating image(s)
May 13 02:03:54.939117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:54.939117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:54.939831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:54.940464 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:54.944525 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:54.945727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:54.962175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:54.962706 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:54.964148 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:54.964617 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:03:54.966887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:54.966887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:54.966887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:54.967260 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] No VIF found with MAC fa:16:3e:06:13:9a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:55.026157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:55.030117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:55.030117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:55.030117 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:55.032247 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:03:55.032798 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:55.070063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:55.076737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:55.078479 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Attaching volume 7f44f074-4f09-468d-a85f-2e778769adcf to /dev/vdb
May 13 02:03:55.108748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:55.118596 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:55.121951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:55.149171 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:55.166249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:55.173314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk 1073741824" returned: 0 in 0.054s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:55.177115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:55.177115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:55.200844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:55.237708 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:55.238506 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:55.255129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:55.255359 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:feec:a9ef', 'fe80::107d:36ff:febf:ff60', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:55.255696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:55.255916 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:55.256284 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:55.256938 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating existing volume attachment record: 329043df-5644-43c5-8c26-ec7e931bcd0a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:55.259335 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:55.263116 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:03:55.263116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:55.348238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:55.348691 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Cannot resize image /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:03:55.349665 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:03:55.349665 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Ensure instance console log exists: /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:03:55.349796 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:55.349984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:55.350171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:55.414395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b022dde2-ec67-4046-8c3a-e24ac1c22b11 req-ed011ae9-c538-4b81-a9ea-51b03013771f service nova] Releasing lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:55.414899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquired lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:03:55.415223 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:03:55.556764 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:55.579340 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:55.581689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:55.581689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:55.581689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:55.581689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:55.584965 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Terminating instance
May 13 02:03:55.827085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:55.827508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:55.827675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:55.828065 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:55.828322 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:55.838453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:55.839043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:55.839529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:55.839702 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:55.840134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:55.840442 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:55.851265 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:55.851265 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:55.856452 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:55.856452 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:55.862797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:55.869872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.878976 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.879339 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:55.879601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.040s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:55.879601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:55.880388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] HCTL ('17', '0', '0', 0) found on session 13 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:55.880512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:55.889181 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching for a device in session 13 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:55.889394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.889845 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:55.890119 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:55.890361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:55.890361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:55.890981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] HCTL ('18', '0', '0', 0) found on session 14 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:55.891102 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:55.899294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Searching for a device in session 14 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:55.899452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:55.980209 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:03:56.020500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.090155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:03:56.103612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.104076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.124706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.143482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.150271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.180133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.197437 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:56.200154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.205918 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:56.206022 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:56.206159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:56.207873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.262542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:56.263077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:56.300038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.300672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.409740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.410551 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:56.418209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.440941 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998615063999978 future=<Future at 0x705c882db140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:56.441699 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998036047000141 future=<Future at 0x705c882db140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:56.441699 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99785741400001 future=<Future at 0x705c882db140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:03:56.443401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:56.443401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:56.443786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:41:4e:0e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:56.444404 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Using config drive
May 13 02:03:56.448313 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Instance destroyed successfully.
May 13 02:03:56.449278 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lazy-loading 'resources' on Instance uuid ed53f547-41ea-4014-a290-8be7d50148aa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:56.456645 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Updating instance_info_cache with network_info: [{"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:56.499108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.519140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.519732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.554203 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1937bdc5-f389-4b88-b8d0-1263a849bb9a tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.559s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:56.559550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:56.559833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:56.560031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:56.560221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:56.560981 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] No waiting events found dispatching network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:56.561344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9dd1f6a3-33f1-4592-9a4a-3f5516b04e33 req-b2813232-6603-4352-aa12-7b72fedba32c service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:56.616353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.621117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.659863 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:56.660016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:56.660386 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attaching volume 8976cef6-0dd2-4a42-822e-4ca6754debd5 to /dev/vdb
May 13 02:03:56.703995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.707207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.721768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] volume_snapshot_create: create_info: {'snapshot_id': 'bdb436ff-def5-455b-80e5-caac84164874', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98103) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 13 02:03:56.726819 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:56.730632 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] snap xml: <domainsnapshot>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:   <disks>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:     <disk name="/dev/dm-8" snapshot="external" type="file">
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:       <source file="/dev/new_file"/>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:     <disk name="vda" snapshot="no"/>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:     <disk name="hda" snapshot="no"/>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:   </disks>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]: </domainsnapshot>
May 13 02:03:56.730632 np0000000663 nova-compute[98103]:  {{(pid=98103) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 13 02:03:56.731291 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] Lazy-loading 'system_metadata' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:56.739705 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f497cf62-9cd7-4492-aa61-5e1036b98d97 tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] volume_snapshot_delete: delete_info: {'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf'} {{(pid=98103) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [None req-f497cf62-9cd7-4492-aa61-5e1036b98d97 tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Traceback (most recent call last):
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     self._volume_snapshot_delete(context, instance, volume_id,
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     if delete_info['type'] != 'qcow2':
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]        ~~~~~~~~~~~^^^^^^^^
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] KeyError: 'type'
May 13 02:03:56.745880 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] 
May 13 02:03:56.755466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:03:56.769865 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:03:56.785854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [None req-f497cf62-9cd7-4492-aa61-5e1036b98d97 tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f2367339-27a6-46ec-ab07-6af31ff1a141)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 13 02:03:56.812294 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:56.822471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.823488 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:56.826399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:03:56.826703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:03:56.832732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server [None req-f497cf62-9cd7-4492-aa61-5e1036b98d97 tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] Exception during message handling: KeyError: 'type'
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 13 02:03:56.861758 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server 
May 13 02:03:56.862739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:03:56.865805 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe06:139a', 'fe80::c853:b6ff:fecc:7fbc', 'fe80::fc16:3eff:fecc:d247', 'fe80::8063:a3ff:fecc:7ccf', 'fe80::fc16:3eff:fe06:367f', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922'] 
May 13 02:03:56.866075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:03:56.866726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:03:56.867108 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:56.867423 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating existing volume attachment record: 4f53fa2b-f90b-414a-8625-47991ebecfc6 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:03:56.874904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:03:56.914713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:56.917129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:56.953954 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:56.958110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1670296637',display_name='tempest-AttachSCSIVolumeTestJSON-server-1670296637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachscsivolumetestjson-server-1670296637',id=3,image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/f04crFB9EGgxBCj/CZMxoufrru1xmdTDjboSKQ6gmTKAjTcFKFugZD+2bZSDoxmHe84wLbT5/UO+wg7I1eU3Jp0fj68sYFIo0siLa631W+Z1v/R7fk+rdTmlm8i45iw==',key_name='tempest-keypair-267749851',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:02:58Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bd9cdc95eb54a1fb998d954aad862a2',ramdisk_id='',reservation_id='r-yzamwf4e',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4d79732b-80a3-4131-80e8-6651e8ba49ae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1712914803',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1712914803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abbf989ad455457b9f26484098001164',uuid=ed53f547-41ea-4014-a290-8be7d50148aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:03:56.962392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Releasing lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:03:56.963005 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converting VIF {"id": "040d625d-14d0-402b-b2da-88af0ae26f43", "address": "fa:16:3e:ec:a9:ef", "network": {"id": "aeff293f-66b3-4d5b-8414-e6dd962c1a81", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-363767559-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5bd9cdc95eb54a1fb998d954aad862a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040d625d-14", "ovs_interfaceid": "040d625d-14d0-402b-b2da-88af0ae26f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:56.963967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance network_info: |[{"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:03:56.964432 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:56.964964 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:03:56.967648 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Start _get_guest_xml network_info=[{"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:03:56.971766 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:56.973714 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1290694761', uuid='e2a3610f-9e9b-41d1-a3ba-96ded5816117'), owner=OwnerMeta(userid='0ff4dd8b153c4ae98a37ba022bb538c6', username='tempest-AttachVolumeNegativeTest-603660763-project-member', projectid='4b9a7e74db544084a4907abd0f241e8b', projectname='tempest-AttachVolumeNegativeTest-603660763'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637836.9731882) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:03:56.974254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.974563 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap040d625d-14, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:56.975803 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.976735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:56.978485 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:03:56.979158 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:03:56.985121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:03:56.985121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:03:56.985802 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:03:56.985844 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:03:56.986047 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:03:56.986224 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:03:56.986670 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.987343 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:03:56.988174 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:03:56.988593 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:56.988922 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:03:56.989214 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:03:56.989374 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:03:56.989578 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:03:56.989741 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:03:56.989912 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:03:57.003747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=913348e1-c473-4e5d-a380-8123b95080be) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.005589 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:57.013185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.017015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.020244 np0000000663 nova-compute[98103]: INFO os_vif [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:a9:ef,bridge_name='br-int',has_traffic_filtering=True,id=040d625d-14d0-402b-b2da-88af0ae26f43,network=Network(aeff293f-66b3-4d5b-8414-e6dd962c1a81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040d625d-14')
May 13 02:03:57.022224 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000003, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa/disk
May 13 02:03:57.032491 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Deleting instance files /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa_del
May 13 02:03:57.032918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.051402 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1290694761',display_name='tempest-AttachVolumeNegativeTest-server-1290694761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1290694761',id=11,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBblkPtWayCrz5ZEV4gthqJvTQxOAjSYCgLh0ZOk2GjOlOmnSZYSYDW6FRWE2gyJwGP/FmP7tpWb1B9R4KKU3wsGyzLXoq1tBfXUsW9Kf2AwwtHPoqG3YTLdMfigm/r7uw==',key_name='tempest-keypair-827144497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-l3gn6167',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=e2a3610f-9e9b-41d1-a3ba-96ded5816117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:03:57.051768 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:57.063301 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Deletion of /opt/stack/data/nova/instances/ed53f547-41ea-4014-a290-8be7d50148aa_del complete
May 13 02:03:57.069861 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:57.071841 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'pci_devices' on Instance uuid e2a3610f-9e9b-41d1-a3ba-96ded5816117 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:57.113608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.114475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.140340 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Creating config drive at /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.config
May 13 02:03:57.145129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvkwoqnn9 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.194051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.194564 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvkwoqnn9" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.195244 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:03:57.198028 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.240282 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Traceback (most recent call last):
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.247723 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] 
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Traceback (most recent call last):
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     self._volume_snapshot_create(context, instance, guest,
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.248582 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] 
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot bdb436ff-def5-455b-80e5-caac84164874 could not be found.
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot bdb436ff-def5-455b-80e5-caac84164874 could not be found. (HTTP 404) (Request-ID: req-c0ff2eef-24ca-4f83-a834-319ee29d95e2)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot bdb436ff-def5-455b-80e5-caac84164874 could not be found.
May 13 02:03:57.277843 np0000000663 nova-compute[98103]: ERROR nova.virt.libvirt.driver 
May 13 02:03:57.280244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.280721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server [None req-9f58c6ce-b0de-4943-ae1e-ff60e5e4b6cc tempest-VolumesAssistedSnapshotsTest-437652011 tempest-VolumesAssistedSnapshotsTest-437652011-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     raise self.value
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 13 02:03:57.309569 np0000000663 nova-compute[98103]: ERROR oslo_messaging.rpc.server 
May 13 02:03:57.339632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:57.340372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:57.343514 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:03:57.343637 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Claim successful on node np0000000663
May 13 02:03:57.360603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.365024 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:03:57.365024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:57.391449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.026s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:57.391771 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12065MB free_disk=74.56428146362305GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:03:57.391995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:57.434218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:03:57.434745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:03:57.434973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:57.534860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:57.534860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:57.581624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] End _get_guest_xml xml=<domain type="qemu">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <uuid>e2a3610f-9e9b-41d1-a3ba-96ded5816117</uuid>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <name>instance-0000000b</name>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1290694761</nova:name>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:03:56</nova:creationTime>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:user uuid="0ff4dd8b153c4ae98a37ba022bb538c6">tempest-AttachVolumeNegativeTest-603660763-project-member</nova:user>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:project uuid="4b9a7e74db544084a4907abd0f241e8b">tempest-AttachVolumeNegativeTest-603660763</nova:project>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         <nova:port uuid="df9aaa56-b5c8-4e32-856f-e44e6e3110e2">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <system>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="serial">e2a3610f-9e9b-41d1-a3ba-96ded5816117</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="uuid">e2a3610f-9e9b-41d1-a3ba-96ded5816117</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </system>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <os>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </os>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <features>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </features>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   <devices>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.config"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </disk>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:21:f6:45"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <target dev="tapdf9aaa56-b5"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </interface>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/console.log" append="off"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </serial>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <video>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </video>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </rng>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:   </devices>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]: </domain>
May 13 02:03:57.581624 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:03:57.583264 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Preparing to wait for external event network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:03:57.584531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:57.585145 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:57.585473 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:57.586491 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1290694761',display_name='tempest-AttachVolumeNegativeTest-server-1290694761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1290694761',id=11,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBblkPtWayCrz5ZEV4gthqJvTQxOAjSYCgLh0ZOk2GjOlOmnSZYSYDW6FRWE2gyJwGP/FmP7tpWb1B9R4KKU3wsGyzLXoq1tBfXUsW9Kf2AwwtHPoqG3YTLdMfigm/r7uw==',key_name='tempest-keypair-827144497',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-l3gn6167',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:03:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=e2a3610f-9e9b-41d1-a3ba-96ded5816117,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:03:57.586710 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:03:57.589290 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:03:57.589677 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:03:57.590238 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.590626 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.590927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:03:57.591310 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Took 1.50 seconds to destroy the instance on the hypervisor.
May 13 02:03:57.591990 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:03:57.592195 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:03:57.592298 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:03:57.592619 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:57.595573 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.596204 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fe36db8-699b-520f-a426-286314f796c0', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.599597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.599597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:57.606550 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.611494 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.611782 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf9aaa56-b5, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.612256 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf9aaa56-b5, col_values=(('qos', UUID('37f0371c-187b-4463-9f6e-2a3fb0501c95')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.612517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf9aaa56-b5, col_values=(('external_ids', {'iface-id': 'df9aaa56-b5c8-4e32-856f-e44e6e3110e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:f6:45', 'vm-uuid': 'e2a3610f-9e9b-41d1-a3ba-96ded5816117'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:03:57.616256 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.618109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:03:57.627184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.627184 np0000000663 nova-compute[98103]: INFO os_vif [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5')
May 13 02:03:57.647394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.683586 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.691727 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:57.692959 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.778859 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:57.889547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found WWN 330000000ae1c0756 for multipath device dm-7 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:03:57.889547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.061s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:57.889547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] <== connect_volume: return (2061ms) {'type': 'block', 'scsi_wwn': '330000000ae1c0756', 'path': '/dev/dm-7', 'multipath_id': '330000000ae1c0756'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:03:57.889547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ae1c0756', 'path': '/dev/dm-7', 'multipath_id': '330000000ae1c0756'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:03:57.890881 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.456s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:57.892750 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:03:57.896773 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:03:57.916713 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:57.917528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:03:57.919706 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:57.920336 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:57.921013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:03:57.921334 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:57.937543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:57.937543 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:57.946120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:03:57.946120 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:57.953736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:03:57.953736 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:57.953736 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:57.953736 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:57.953736 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:57.953736 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:57.953736 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:57.954036 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:57.954081 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:57.954877 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:57.958667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:03:57.958667 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:03:57.958667 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:57.958667 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:57.958667 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:03:57.958667 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:03:57.958667 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:57.958904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:03:57.959005 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0378(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:03:57.959168 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:03:57.994559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:58.002013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:58.022688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75c3b5d0-15f5-4e59-bdf5-86f90e9534de req-b40b1826-1b8b-4bf8-8c66-4debae16395b service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:58.023194 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75c3b5d0-15f5-4e59-bdf5-86f90e9534de req-b40b1826-1b8b-4bf8-8c66-4debae16395b service nova] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:58.023570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75c3b5d0-15f5-4e59-bdf5-86f90e9534de req-b40b1826-1b8b-4bf8-8c66-4debae16395b service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:58.023809 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75c3b5d0-15f5-4e59-bdf5-86f90e9534de req-b40b1826-1b8b-4bf8-8c66-4debae16395b service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:58.024105 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75c3b5d0-15f5-4e59-bdf5-86f90e9534de req-b40b1826-1b8b-4bf8-8c66-4debae16395b service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Processing event network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:03:58.024655 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:58.028767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:03:58.036692 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Detaching volume 84a3e029-be6d-45ff-b87d-db0b51ddfadf
May 13 02:03:58.088272 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Attempting to driver detach volume 84a3e029-be6d-45ff-b87d-db0b51ddfadf from mountpoint /dev/vdb
May 13 02:03:58.097902 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Found disk vdb by alias ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:03:58.099621 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Found disk vdb by alias ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:03:58.099735 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Attempting to detach device vdb from instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:03:58.099932 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] detach device xml: <disk type="block" device="disk">
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <alias name="ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf"/>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <serial>84a3e029-be6d-45ff-b87d-db0b51ddfadf</serial>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:58.099932 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:03:58.112153 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Successfully detached device vdb from instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c from the persistent domain config.
May 13 02:03:58.112349 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] (1/8): Attempting to detach device vdb with device alias ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf from instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:03:58.112696 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] detach device xml: <disk type="block" device="disk">
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <alias name="ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf"/>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <serial>84a3e029-be6d-45ff-b87d-db0b51ddfadf</serial>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:58.112696 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:03:58.398771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Attempting to attach volume 7f44f074-4f09-468d-a85f-2e778769adcf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:03:58.402555 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]: </disk>
May 13 02:03:58.402555 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:03:58.615617 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:03:58.618137 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637838.6176503, 1a8c3497-e0fe-475c-ad89-fccdb35ab740 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:58.618296 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] VM Started (Lifecycle Event)
May 13 02:03:58.621193 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:03:58.623492 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance spawned successfully.
May 13 02:03:58.623920 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:03:58.639217 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:03:58.640332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] Acquiring lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:03:58.641626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:03:58.641626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] Lock "ed53f547-41ea-4014-a290-8be7d50148aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:03:58.641626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] No waiting events found dispatching network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:03:58.641626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-06004482-9668-4f01-9335-9cf9648daec6 req-8d5d637f-4138-469e-b28a-76825485c54b service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-unplugged-040d625d-14d0-402b-b2da-88af0ae26f43 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:03:58.750542 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf for instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:03:58.958280 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:03:58.959689 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:58.976341 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:58.976341 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:03:58.983926 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:03:58.983926 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:58.990864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.001905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.015428 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.015871 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.026196 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:59.029196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:03:59.029196 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:03:59.031640 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:03:59.090995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:03:59.090995 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:03:59.090995 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.108079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:03:59.108079 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:03:59.108079 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.109517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.121296 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:59.124422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:03:59.126913 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:03:59.138591 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.138758 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.139668 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:59.140285 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.140385 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:59.140854 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.141125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.141829 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:59.142054 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:03:59.145438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:59.147007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('15', '-', '-', 0) found on session 17 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:59.147185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:03:59.156129 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:03:59.156991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:03:59.156991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:03:59.157133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:59.157248 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:03:59.157366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:21:f6:45, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:03:59.158194 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Using config drive
May 13 02:03:59.161190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('16', '-', '-', 0) found on session 18 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:03:59.161403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:03:59.170492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 17 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:59.170492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:59.186380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 18 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:03:59.186380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:03:59.532076 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:03:59.537349 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Took 1.94 seconds to deallocate network for instance.
May 13 02:03:59.635317 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:03:59.635770 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637839.6353402, 1a8c3497-e0fe-475c-ad89-fccdb35ab740 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:03:59.635770 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] VM Paused (Lifecycle Event)
May 13 02:03:59.649710 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Took 7.43 seconds to spawn the instance on the hypervisor.
May 13 02:03:59.649951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:03:59.666910 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:03:59.821347 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Creating config drive at /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.config
May 13 02:03:59.826646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxdi24ysc {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:03:59.866472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxdi24ysc" returned: 0 in 0.039s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:03:59.919867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:04:00.041864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.702s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:00.042997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.650s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:00.044247 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:04:00.048289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:00.082277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:00.082277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:00.082277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:00.082654 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] No VIF found with MAC fa:16:3e:06:36:7f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] No waiting events found dispatching network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received unexpected event network-vif-plugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 for instance with vm_state active and task_state None.
May 13 02:04:00.115589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-38a75042-0cf3-4a64-9047-67105e60ec90 req-273e0225-0843-4462-8d8c-a4674832d0b0 service nova] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Received event network-vif-deleted-040d625d-14d0-402b-b2da-88af0ae26f43 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:00.115828 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.138544 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:00.146789 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637840.1463912, 1a8c3497-e0fe-475c-ad89-fccdb35ab740 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:00.146985 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] VM Resumed (Lifecycle Event)
May 13 02:04:00.163719 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Took 13.16 seconds to build instance.
May 13 02:04:00.328836 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.358349 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.360374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.460606 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.483793 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.485748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:00.523120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-943b829e-9a14-47f7-b7a0-ee3e526aece0 req-38a61376-8a8e-44e1-86c9-d14833e2630d service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:00.523394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-943b829e-9a14-47f7-b7a0-ee3e526aece0 req-38a61376-8a8e-44e1-86c9-d14833e2630d service nova] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:00.523613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-943b829e-9a14-47f7-b7a0-ee3e526aece0 req-38a61376-8a8e-44e1-86c9-d14833e2630d service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:00.523754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-943b829e-9a14-47f7-b7a0-ee3e526aece0 req-38a61376-8a8e-44e1-86c9-d14833e2630d service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:00.523874 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-943b829e-9a14-47f7-b7a0-ee3e526aece0 req-38a61376-8a8e-44e1-86c9-d14833e2630d service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Processing event network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:00.568489 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:04:00.569034 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:04:00.569442 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:00.569806 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:00.649857 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:00.652291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:00.667120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.668s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:00.678359 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33425a40c04d488bba6393ace2394be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeca98c5180647b2910bdd1f13ac4196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:04:00.936838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Found WWN 330000000236426d5 for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:00.937535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:00.937772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== connect_volume: return (3503ms) {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-6', 'multipath_id': '330000000236426d5'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:00.937949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-6', 'multipath_id': '330000000236426d5'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:00.939969 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'flavor' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:01.068183 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:04:01.129302 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.129701 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.129905 np0000000663 nova-compute[98103]: WARNING nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ed53f547-41ea-4014-a290-8be7d50148aa is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 13 02:04:01.130586 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130586 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130586 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130586 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2973c226-2c35-4da1-bd21-cddd0fcbbb34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130586 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130805 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1a8c3497-e0fe-475c-ad89-fccdb35ab740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.130985 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e2a3610f-9e9b-41d1-a3ba-96ded5816117 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.131163 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance f757f7c1-4179-4c49-b986-a95d500f90ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:01.131426 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:04:01.131644 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:03:57 up 27 min,  2 users,  load average: 7.81, 3.89, 1.83\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '9', 'num_os_type_None': '10', 'num_proj_4b9a7e74db544084a4907abd0f241e8b': '2', 'io_workload': '2', 'num_proj_a6194cae22b64d2c9601d523690e9ed9': '1', 'num_proj_a54e73cd5d334cb59d7e916a47e98db7': '2', 'num_proj_f64cf62c02d24c7680e5ac91383a3afb': '1', 'num_proj_45aa68ef76ab4ec78cb3d85b6cf5dc57': '1', 'num_proj_eeca98c5180647b2910bdd1f13ac4196': '2', 'num_proj_32377a41c4fc4e2781fdff3229fc3395': '1', 'num_vm_building': '2', 'num_task_spawning': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:04:01.159837 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637841.1594987, 90b73edb-7021-4d08-90fe-4cd3f5678c7c => ua-84a3e029-be6d-45ff-b87d-db0b51ddfadf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:04:01.164306 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Successfully detached device vdb from instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c from the live domain config.
May 13 02:04:01.166036 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:01.166517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:01.167080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:01.167562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:01.167902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84a3e029-be6d-45ff-b87d-db0b51ddfadf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:01.168166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:01.205857 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637841.2051227, e2a3610f-9e9b-41d1-a3ba-96ded5816117 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:01.205857 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] VM Started (Lifecycle Event)
May 13 02:04:01.207910 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:01.212050 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:04:01.215591 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance spawned successfully.
May 13 02:04:01.217677 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:01.224010 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:01.224647 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '16'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:01.224647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '15')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:01.229494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf', '16')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:01.230841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c69af20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'): ({'sdo'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:01.231071 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Removing multipathed devices sdn, sdo {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:01.232344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Flush multipath device 33000000072ddb2c3 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:01.276527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:01.311142 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Successfully created port: 77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:04:01.347353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:01.390510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:01.390790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:01.392309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:01.412281 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:01.413030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:01.430695 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.442958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attempting to attach volume 8976cef6-0dd2-4a42-822e-4ca6754debd5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:04:01.447440 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:   <alias name="ua-8976cef6-0dd2-4a42-822e-4ca6754debd5"/>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:   <serial>8976cef6-0dd2-4a42-822e-4ca6754debd5</serial>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:01.447440 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:04:01.476415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.40.100,3260]
May 13 02:04:01.476415 np0000000663 nova-compute[98103]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.40.100,3260] successful.
May 13 02:04:01.476415 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.499154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.514998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.565792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.50.100,3260]
May 13 02:04:01.565792 np0000000663 nova-compute[98103]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-84a3e029-be6d-45ff-b87d-db0b51ddfadf, portal: 192.168.50.100,3260] successful.
May 13 02:04:01.565792 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.577330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:04:01.596826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:01.597035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:01.597355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] <== disconnect_volume: return (430ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:01.597468 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:01.690514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-632630a0-2f45-43be-b3cb-fb0f47665c83 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.614s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:01.712046 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:01.715500 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:01.731144 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:01.731144 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:01.732735 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:01.732913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:01.733267 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:01.733601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:02.003169 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Successfully updated port: 77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:04:02.041843 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:02.042062 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:02.180879 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-changed-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:02.181053 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Refreshing instance network info cache due to event network-changed-77e46685-d447-44ae-a646-bea635926fda. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:02.181247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] Acquiring lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:02.181375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] Acquired lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:02.181488 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Refreshing network info cache for port 77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:02.193626 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lazy-loading 'flavor' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:02.219157 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:04:02.222907 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637842.2192519, e2a3610f-9e9b-41d1-a3ba-96ded5816117 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:02.223564 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] VM Paused (Lifecycle Event)
May 13 02:04:02.240154 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Took 7.30 seconds to spawn the instance on the hypervisor.
May 13 02:04:02.240330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:02.505229 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:02.544500 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:02.590178 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:04:02.590178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:04:02.590178 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating image(s)
May 13 02:04:02.590178 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:02.590358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:02.590644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:02.591086 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:02.596694 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:02.600917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:02.615586 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:02.619667 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:02.620366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:02.622151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:02.622151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:02.622151 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] No waiting events found dispatching network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:02.622151 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-0ebd7345-814e-4c89-afe3-5d648891b4fb req-99c1ede4-ed61-4c41-86fa-f81bc45bd8d7 service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received unexpected event network-vif-plugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 for instance with vm_state active and task_state None.
May 13 02:04:02.679540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.081s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:02.682236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:02.682236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:02.682236 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:02.683613 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:02.683997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:02.685613 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:02.728290 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:02.733319 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637842.7329557, e2a3610f-9e9b-41d1-a3ba-96ded5816117 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:02.733612 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] VM Resumed (Lifecycle Event)
May 13 02:04:02.749571 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Took 15.57 seconds to build instance.
May 13 02:04:02.784738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:02.785255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:02.809036 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:02.830318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk 1073741824" returned: 0 in 0.045s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:02.830985 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:02.831484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:02.916101 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:02.916346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:02.925049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:02.925573 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:04:02.925870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:02.967321 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:03.002877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:03.003452 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Cannot resize image /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:04:03.003816 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:04:03.004393 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Ensure instance console log exists: /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:03.004393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:03.004668 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:03.004830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:03.017262 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:03.051833 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:04:03.052084 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.010s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:03.052566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:03.052731 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.83 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:03.056115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:03.110377 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Deleted allocations for instance ed53f547-41ea-4014-a290-8be7d50148aa
May 13 02:04:03.149589 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:03.149755 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:03.149813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:03.149948 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No VIF found with MAC fa:16:3e:64:87:88, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:03.213520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5976fb74-4125-4c9b-b2cb-2a6ea364ab4c tempest-VolumesAssistedSnapshotsTest-82378005 tempest-VolumesAssistedSnapshotsTest-82378005-project-admin] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.680s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:03.239081 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:03.244366 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:03.258152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2e086588-806a-4974-bbae-648c95d062e1 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.091s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:03.421729 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Detaching volume 7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:04:03.477249 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] instance snapshotting
May 13 02:04:03.489005 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Attempting to driver detach volume 7f44f074-4f09-468d-a85f-2e778769adcf from mountpoint /dev/vdb
May 13 02:04:03.494828 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found disk vdb by alias ua-7f44f074-4f09-468d-a85f-2e778769adcf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:03.496324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found disk vdb by alias ua-7f44f074-4f09-468d-a85f-2e778769adcf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:03.496499 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Attempting to detach device vdb from instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:04:03.496832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:03.496832 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:03.505220 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully detached device vdb from instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 from the persistent domain config.
May 13 02:04:03.505398 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] (1/8): Attempting to detach device vdb with device alias ua-7f44f074-4f09-468d-a85f-2e778769adcf from instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:04:03.505730 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:03.505730 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:03.519890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2586d04-f5d8-4bab-b65c-c383cff7e2b2 req-2d236aca-6718-425a-8e83-6bc895961f2b service nova] Releasing lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:03.521244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:03.521244 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:03.593296 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Beginning live snapshot process
May 13 02:04:04.092228 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:04.100433 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637844.099809, e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 => ua-7f44f074-4f09-468d-a85f-2e778769adcf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:04:04.101658 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7f44f074-4f09-468d-a85f-2e778769adcf for instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:04:04.104322 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully detached device vdb from instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 from the live domain config.
May 13 02:04:04.119785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-742ced66-53ee-4865-a5ba-607778f3df31 tempest-AttachSCSIVolumeTestJSON-1712914803 tempest-AttachSCSIVolumeTestJSON-1712914803-project-member] Lock "ed53f547-41ea-4014-a290-8be7d50148aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.540s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:04.259011 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:04.268034 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-changed-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:04.268224 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Refreshing instance network info cache due to event network-changed-df9aaa56-b5c8-4e32-856f-e44e6e3110e2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:04.268422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] Acquiring lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:04.268686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] Acquired lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:04.268844 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Refreshing network info cache for port df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:04.413306 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating instance_info_cache with network_info: [{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:04.650391 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Detected multiple connections on this host for volume: 7f44f074-4f09-468d-a85f-2e778769adcf, skipping target disconnect.
May 13 02:04:04.713046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bc8e737-8a54-480d-885e-62afab48f734 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.053s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:04.771172 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:04.915416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:04.915692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance network_info: |[{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:04:04.917335 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start _get_guest_xml network_info=[{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:04.922484 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:04.923699 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-585778022', uuid='f757f7c1-4179-4c49-b986-a95d500f90ad'), owner=OwnerMeta(userid='33425a40c04d488bba6393ace2394be5', username='tempest-ServerActionsTestOtherA-1936571963-project-member', projectid='eeca98c5180647b2910bdd1f13ac4196', projectname='tempest-ServerActionsTestOtherA-1936571963'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637844.923191) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:04.924967 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:04.925745 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:04.926206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:04.926579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:04.927622 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:04.927665 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:04.927808 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:04.927903 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:04.929168 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:04.950849 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-tempest.common.compute-instance-585778022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:04.951285 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:04.952809 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:04.954101 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'pci_devices' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:05.111523 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:05.123148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.128612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:05.135219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:05.139136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:05.139136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:05.139136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:05.145585 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Terminating instance
May 13 02:04:05.175839 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:05.197973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json -f qcow2" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:05.198731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:05.229855 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:05.297692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json -f qcow2" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:05.298649 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:05.306699 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:05.307310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:05.400377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:05.400905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34.delta 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:05.416366 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Updated VIF entry in instance network info cache for port df9aaa56-b5c8-4e32-856f-e44e6e3110e2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:04:05.417224 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Updating instance_info_cache with network_info: [{"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:05.443964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34.delta 1073741824" returned: 0 in 0.043s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:05.444396 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 02:04:05.461595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <uuid>f757f7c1-4179-4c49-b986-a95d500f90ad</uuid>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <name>instance-0000000c</name>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:name>tempest-tempest.common.compute-instance-585778022</nova:name>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:04</nova:creationTime>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:user uuid="33425a40c04d488bba6393ace2394be5">tempest-ServerActionsTestOtherA-1936571963-project-member</nova:user>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:project uuid="eeca98c5180647b2910bdd1f13ac4196">tempest-ServerActionsTestOtherA-1936571963</nova:project>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         <nova:port uuid="77e46685-d447-44ae-a646-bea635926fda">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="serial">f757f7c1-4179-4c49-b986-a95d500f90ad</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="uuid">f757f7c1-4179-4c49-b986-a95d500f90ad</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:1d:2a:66"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <target dev="tap77e46685-d4"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/console.log" append="off"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:05.461595 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:05.464023 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Preparing to wait for external event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:04:05.464023 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:05.464023 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:05.464023 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:05.464023 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-tempest.common.compute-instance-585778022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:05.464373 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:05.465733 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:05.465733 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:05.467590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.467900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:05.468199 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:05.472391 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.472666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '749fd00c-587c-5948-995d-e05cccb43487', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:05.484146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.485276 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:05.486056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.491572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.491572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e46685-d4, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:05.491572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77e46685-d4, col_values=(('qos', UUID('c5c9b65a-36ec-463f-b468-8c3306280218')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:05.491572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77e46685-d4, col_values=(('external_ids', {'iface-id': '77e46685-d447-44ae-a646-bea635926fda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:2a:66', 'vm-uuid': 'f757f7c1-4179-4c49-b986-a95d500f90ad'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:05.493617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.493617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:05.503686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.503686 np0000000663 nova-compute[98103]: INFO os_vif [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4')
May 13 02:04:05.647598 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:05.679602 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.688601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.707668 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.738696 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.741703 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:05.746891 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:04:05.751437 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 02:04:05.808228 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:04:05.808730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34.delta /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:05.924507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28108aae-6f56-44b1-adb7-d5536fc15bfb req-64563c72-d5c6-4c3e-9294-31d2a5b306ed service nova] Releasing lock "refresh_cache-e2a3610f-9e9b-41d1-a3ba-96ded5816117" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:05.933584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34.delta /opt/stack/data/nova/instances/snapshots/tmptez9l5_4/7e21390e13844486963178f6c592ea34" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:05.934208 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Snapshot extracted, beginning image upload
May 13 02:04:05.993939 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999223316000098 future=<Future at 0x705c6c62c110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:05.999357 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Instance destroyed successfully.
May 13 02:04:06.003467 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lazy-loading 'resources' on Instance uuid 90b73edb-7021-4d08-90fe-4cd3f5678c7c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:06.237238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-18d73ccc-f87d-489f-94d4-abfc6d5abce1 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.321s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:06.373529 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:06.373729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:06.374065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:06.374149 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:06.374286 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] No waiting events found dispatching network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:06.374697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:06.374833 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:06.375076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Acquiring lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:06.375236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:06.375385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:06.375538 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] No waiting events found dispatching network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:06.375671 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5aff787d-f924-45a6-8ce0-ea52366e95da req-9054d8c7-d315-4d09-a6e0-cbc260046308 service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-unplugged-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:06.505423 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785590323',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785590323',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesassistedsnapshotstest-server-1785590323',id=2,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0xsyIvuVkUaUXZyC8LFAM3d9MOQAlYTQGTzbA4ofVyyO3Wx7IE0e0WgS4KfGU50Ajagyg6IdJ7B1hDbnnbQJWn5DkHTwIsT8nyxyyCvA0R+UuSyNuHww2i9HWfUpDlXQ==',key_name='tempest-keypair-31812889',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:08Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6194cae22b64d2c9601d523690e9ed9',ramdisk_id='',reservation_id='r-1nw8hy7e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-751673082',owner_user_name='tempest-VolumesAssistedSnapshotsTest-751673082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb5a50d9fe9464e9ad258c960828d6e',uuid=90b73edb-7021-4d08-90fe-4cd3f5678c7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:06.505979 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converting VIF {"id": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "address": "fa:16:3e:06:13:9a", "network": {"id": "c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1115172240-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6194cae22b64d2c9601d523690e9ed9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa24e67c8-24", "ovs_interfaceid": "a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:06.506876 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:06.507228 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:06.509283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:06.509630 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa24e67c8-24, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:06.511058 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:06.512287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:06.519531 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:06.523230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:06.526632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3760ae0a-14ba-4c71-806d-6e3321e627cc) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:06.534856 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:06.540864 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:06.544605 np0000000663 nova-compute[98103]: INFO os_vif [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:13:9a,bridge_name='br-int',has_traffic_filtering=True,id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8,network=Network(c9ebe75d-e6cd-4dd3-9c43-3ed399fd9840),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa24e67c8-24')
May 13 02:04:06.544749 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Deleting instance files /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c_del
May 13 02:04:06.545621 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Deletion of /opt/stack/data/nova/instances/90b73edb-7021-4d08-90fe-4cd3f5678c7c_del complete
May 13 02:04:07.038057 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:07.038295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:07.038496 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:1d:2a:66, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:07.039195 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Using config drive
May 13 02:04:07.058387 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:04:07.062421 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:07.062899 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:07.063462 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:07.063462 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:07.140514 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:07.408280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:07.410985 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:07.550900 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:07.730346 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating config drive at /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config
May 13 02:04:07.738383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpajnd4hgv {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:07.774440 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Stashing vm_state: active {{(pid=98103) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 02:04:07.789767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpajnd4hgv" returned: 0 in 0.051s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:07.875117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-224622f2-a548-47d6-814a-b483598c883b req-5f4e70cb-bd1d-4d9d-91d5-27eef0fcf70f service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Received event network-vif-deleted-a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:07.875117 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-224622f2-a548-47d6-814a-b483598c883b req-5f4e70cb-bd1d-4d9d-91d5-27eef0fcf70f service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Neutron deleted interface a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8; detaching it from the instance and deleting it from the info cache
May 13 02:04:07.875117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-224622f2-a548-47d6-814a-b483598c883b req-5f4e70cb-bd1d-4d9d-91d5-27eef0fcf70f service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:07.914407 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Detaching volume 7f44f074-4f09-468d-a85f-2e778769adcf
May 13 02:04:07.998428 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Attempting to driver detach volume 7f44f074-4f09-468d-a85f-2e778769adcf from mountpoint /dev/vdb
May 13 02:04:08.022045 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found disk vdb by alias ua-7f44f074-4f09-468d-a85f-2e778769adcf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:08.028580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Found disk vdb by alias ua-7f44f074-4f09-468d-a85f-2e778769adcf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:08.028697 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Attempting to detach device vdb from instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:04:08.029231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:08.029231 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:08.040517 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully detached device vdb from instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 from the persistent domain config.
May 13 02:04:08.041048 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] (1/8): Attempting to detach device vdb with device alias ua-7f44f074-4f09-468d-a85f-2e778769adcf from instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:04:08.041705 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <alias name="ua-7f44f074-4f09-468d-a85f-2e778769adcf"/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-7"/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <serial>7f44f074-4f09-468d-a85f-2e778769adcf</serial>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:08.041705 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:08.288420 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:08.330668 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.343833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:08.343833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:08.356576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.384172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-224622f2-a548-47d6-814a-b483598c883b req-5f4e70cb-bd1d-4d9d-91d5-27eef0fcf70f service nova] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Detach interface failed, port_id=a24e67c8-24a7-4eaf-8854-07d8bfa9c8b8, reason: Instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:04:08.478519 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.510666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.513382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.580901 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3332dab9-f1b5-40e0-bce7-65c4e3c723bd req-b3f14d39-e979-4ed0-b8a0-5d874cd8d9bd service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:08.580901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3332dab9-f1b5-40e0-bce7-65c4e3c723bd req-b3f14d39-e979-4ed0-b8a0-5d874cd8d9bd service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:08.581973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3332dab9-f1b5-40e0-bce7-65c4e3c723bd req-b3f14d39-e979-4ed0-b8a0-5d874cd8d9bd service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:08.581973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3332dab9-f1b5-40e0-bce7-65c4e3c723bd req-b3f14d39-e979-4ed0-b8a0-5d874cd8d9bd service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:08.582855 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3332dab9-f1b5-40e0-bce7-65c4e3c723bd req-b3f14d39-e979-4ed0-b8a0-5d874cd8d9bd service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Processing event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:08.650106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:08.791000 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Took 1.73 seconds to deallocate network for instance.
May 13 02:04:08.853870 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:04:08.853992 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Claim successful on node np0000000663
May 13 02:04:09.302711 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:09.362233 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating resource usage from migration ad0e139e-f468-4e4d-809a-2bf480830a90
May 13 02:04:09.416614 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:09.419306 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637849.4185908, f757f7c1-4179-4c49-b986-a95d500f90ad => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:09.419306 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Started (Lifecycle Event)
May 13 02:04:09.421922 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:04:09.424082 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance spawned successfully.
May 13 02:04:09.424082 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:04:09.636215 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Snapshot image upload complete
May 13 02:04:09.636215 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-621e7f87-53df-4339-8501-a329d802bb1a tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Took 6.15 seconds to snapshot the instance on the hypervisor.
May 13 02:04:09.922605 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:09.924143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:09.932275 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:09.932840 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:09.934311 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:09.934747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:09.935957 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:09.936600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:10.032263 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:10.032584 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:10.117722 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:10.145606 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:10.187790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7f44f074-4f09-468d-a85f-2e778769adcf for instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:04:10.429625 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:04:10.429625 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637850.42842, f757f7c1-4179-4c49-b986-a95d500f90ad => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:10.429625 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Paused (Lifecycle Event)
May 13 02:04:10.447496 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Took 7.86 seconds to spawn the instance on the hypervisor.
May 13 02:04:10.447637 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:10.535548 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:10.698409 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:10.698790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:10.698903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:10.699105 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:10.699760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:10.699940 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-60ded860-b046-4a66-91dd-b7391c7372a5 req-a0b5df4d-1b2d-458a-a3d0-d782d2f27b44 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received unexpected event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda for instance with vm_state active and task_state None.
May 13 02:04:10.937118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:10.938258 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637850.938028, f757f7c1-4179-4c49-b986-a95d500f90ad => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:10.938400 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Resumed (Lifecycle Event)
May 13 02:04:10.958898 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Took 13.68 seconds to build instance.
May 13 02:04:11.000590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:11.044295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.701s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:11.044473 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Migrating
May 13 02:04:11.044669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:11.044786 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:11.047295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.744s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:11.440645 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0011650700000700454 future=<Future at 0x705c882db140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:11.441713 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:11.442303 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.550745770000049 future=<Future at 0x705c6c62c110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:11.444257 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778637836.4387238, ed53f547-41ea-4014-a290-8be7d50148aa => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:11.444480 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:11.444688 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] VM Stopped (Lifecycle Event)
May 13 02:04:11.446460 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.54664006300004 future=<Future at 0x705c6c62c110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:11.449080 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:11.460811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.198s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:11.536339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:11.550600 np0000000663 nova-compute[98103]: INFO nova.compute.rpcapi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 13 02:04:11.550600 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:11.550600 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:04:11.768427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:11.768775 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:11.949716 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-9c998066-f04a-4026-838c-fa0f1227a46d None None] [instance: ed53f547-41ea-4014-a290-8be7d50148aa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:11.952214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637851.9516768, a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 => ua-7f44f074-4f09-468d-a85f-2e778769adcf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:04:11.956933 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully detached device vdb from instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 from the live domain config.
May 13 02:04:12.000155 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:12.000567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:12.000733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:12.001163 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:12.001652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7f44f074-4f09-468d-a85f-2e778769adcf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:12.001846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:12.046958 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:12.047686 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:12.047686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '13')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:12.048543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf', '14')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:12.049387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c801abba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:12.049593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:12.049820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Flush multipath device 330000000ae1c0756 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:12.069121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:12.069288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:12.079439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:12.079634 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:12.079728 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:12.095993 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:12.145035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:12.201641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:12.201834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:12.203819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:12.219657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:12.219657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:12.234836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.271446 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:12.283142 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.40.100,3260]
May 13 02:04:12.283142 np0000000663 nova-compute[98103]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.40.100,3260] successful.
May 13 02:04:12.283142 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.308963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.325810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.377983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.50.100,3260]
May 13 02:04:12.377983 np0000000663 nova-compute[98103]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-7f44f074-4f09-468d-a85f-2e778769adcf, portal: 192.168.50.100,3260] successful.
May 13 02:04:12.377983 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.406907 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:12.407197 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:12.407361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] <== disconnect_volume: return (406ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:12.407526 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:12.571957 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:04:12.582064 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:12.779112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.732s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:12.786347 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-changed-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:12.786485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Refreshing instance network info cache due to event network-changed-77e46685-d447-44ae-a646-bea635926fda. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:12.786655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] Acquiring lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:12.786745 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] Acquired lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:12.786924 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Refreshing network info cache for port 77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:12.862857 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Deleted allocations for instance 90b73edb-7021-4d08-90fe-4cd3f5678c7c
May 13 02:04:12.972217 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'flavor' on Instance uuid a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:13.039312 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:13.148851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:13.149043 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:13.151963 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:04:13.152128 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Claim successful on node np0000000663
May 13 02:04:13.192725 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:13.290272 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:13.694661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:13.716530 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:13.863058 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updated VIF entry in instance network info cache for port 77e46685-d447-44ae-a646-bea635926fda. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:04:13.863539 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating instance_info_cache with network_info: [{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:13.872551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5edb9ab0-b90a-4580-8b60-30948ace5609 tempest-VolumesAssistedSnapshotsTest-751673082 tempest-VolumesAssistedSnapshotsTest-751673082-project-member] Lock "90b73edb-7021-4d08-90fe-4cd3f5678c7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.737s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:13.980199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c5cea27a-38b2-45f4-8bd7-3a6b1ec5ef3f tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.571s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:14.365974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2cf0d06-a992-47c4-9785-d71a85279886 req-1b1ab160-285f-40d4-9981-5994baf3fabe service nova] Releasing lock "refresh_cache-f757f7c1-4179-4c49-b986-a95d500f90ad" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:14.975370 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:14.975971 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:14.991279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:14.991279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:14.991279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:14.991279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:14.991279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:14.994589 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Terminating instance
May 13 02:04:15.120309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:15.120580 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:15.126772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.134558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:15.142747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.017s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:15.142957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:15.152243 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Terminating instance
May 13 02:04:15.215666 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Starting migrate_disk_and_power_off {{(pid=98103) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 02:04:15.235864 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.242542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.261526 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.265650 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.297286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.479539 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:15.499139 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:15.521764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.530010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.567545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.608337 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99966968700005 future=<Future at 0x705c6c6c4c80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:15.622692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:15.622692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:15.622692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:15.622692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:15.623367 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:15.623655 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-98eb2b57-2190-483e-953b-b0b59981934f req-5885d72a-c303-4f51-b4e4-0cd5c8fd7a51 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state active and task_state resize_migrating.
May 13 02:04:15.624594 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance destroyed successfully.
May 13 02:04:15.628165 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:13Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:15.628165 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:15.628165 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:15.628165 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:15.630715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.631179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11134c0d-52, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:15.634776 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.639281 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:15.643030 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.644749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.645018 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=315508df-ffb7-4c5a-90df-f0d63df5497a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:15.646310 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.648465 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:15.658317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:15.658317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.663276 np0000000663 nova-compute[98103]: INFO os_vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:04:15.667050 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:15.667626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:15.667626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:15.668152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:15.668554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:15.668830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:15.694875 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.700124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.724239 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:15.727387 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:15.728408 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:15.728828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:15.728828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '17')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:15.733931 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '18')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:15.735356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c7880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:15.737211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:15.737211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flush multipath device 330000000236426d5 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:15.746776 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.758958 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.770703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:15.805807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.815578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:15.823720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.840703 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:15.865795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:15.865795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:15.866048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:15.879957 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99970403999987 future=<Future at 0x705c801a1760 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:15.888760 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Instance destroyed successfully.
May 13 02:04:15.891113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:15.891113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:15.893404 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'resources' on Instance uuid a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:15.914153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:15.938078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:15.942274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:15.945369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:15.945369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:15.945369 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] No waiting events found dispatching network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:15.945369 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e4498fe-4a24-4cc2-a6de-e52786630eb8 req-40b15a58-a0f2-4caa-9556-df296831af3e service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:15.960065 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:04:15.960065 np0000000663 nova-compute[98103]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:04:15.960065 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:15.985409 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:15.992425 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.841s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:15.993128 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:04:16.007022 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:16.022984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.046527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.055225 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998999008000055 future=<Future at 0x705c6c7c8410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:16.059801 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:16.060392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:16.060392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:16.060392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:16.062838 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] No waiting events found dispatching network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:16.068359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:04:16.068359 np0000000663 nova-compute[98103]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:04:16.068359 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:16.068359 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-82c8a485-94fc-4a2a-ac77-206e8b02d253 req-7d24b226-75e5-4342-af50-3dbf11727ee3 service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:16.080594 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Instance destroyed successfully.
May 13 02:04:16.080781 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lazy-loading 'resources' on Instance uuid e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:16.096431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:16.096623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:16.096775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== disconnect_volume: return (429ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:16.096919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:16.103897 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:16.197808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:16.200855 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:16.321511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:16.322988 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:04:16.323515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:16.397774 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-1',id=4,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:08Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=a3598ffd-b2b9-472d-bc0b-187a6f5ffae6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:16.398002 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "address": "fa:16:3e:cc:d2:47", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap772c3f74-65", "ovs_interfaceid": "772c3f74-65ab-4239-a55b-7ecf08c6bc79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:16.399421 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:16.399756 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:16.402406 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.402783 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap772c3f74-65, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:16.407288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.407288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:16.416243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.416243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.416243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da8fc8e1-ed9b-4848-a9c3-20be1aa7fc0b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:16.416243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.416243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:16.423359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.426038 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:d2:47,bridge_name='br-int',has_traffic_filtering=True,id=772c3f74-65ab-4239-a55b-7ecf08c6bc79,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap772c3f74-65')
May 13 02:04:16.426608 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Deleting instance files /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6_del
May 13 02:04:16.427941 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Deletion of /opt/stack/data/nova/instances/a3598ffd-b2b9-472d-bc0b-187a6f5ffae6_del complete
May 13 02:04:16.431795 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:16.432432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk.config /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:16.469235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk.config /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config" returned: 0 in 0.036s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:16.469714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk.info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:16.510463 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:04:16.511047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "cp -r /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_resize/disk.info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" returned: 0 in 0.041s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:16.511414 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:04:16.512906 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:16.516339 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:16.584807 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-123586797-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testmultiattachvolumeswap-server-123586797-2',id=5,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDX3EjFnElY6ovWXzvT/gi68xjlEMKJKXrGCdmF8uMOx+mZUPOoHIUYORMtJW7r0xHaffCKfmFJyhajg3j9+a87gimN8Xeh014C6QJbfzdUWM2zpHT3FQ1Bbzak5h1CZgw==',key_name='tempest-keypair-700998881',keypairs=<?>,launch_index=1,launched_at=2026-05-13T02:03:01Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a54e73cd5d334cb59d7e916a47e98db7',ramdisk_id='',reservation_id='r-tjrw0mz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-17294794',owner_user_name='tempest-TestMultiAttachVolumeSwap-17294794-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fddb84e700c34bcb911bea020c300727',uuid=e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:16.585119 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converting VIF {"id": "b954427a-1edc-456a-a562-8652bcf5840e", "address": "fa:16:3e:06:36:7f", "network": {"id": "310d0f08-5e3e-4bc7-a491-3d7c91666d9e", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1526614512-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a54e73cd5d334cb59d7e916a47e98db7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb954427a-1e", "ovs_interfaceid": "b954427a-1edc-456a-a562-8652bcf5840e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:16.585986 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:16.589016 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:16.589418 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.589755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb954427a-1e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:16.591740 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.593295 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.594733 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:16.595838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0591b26-16ea-472a-8306-1fde2632ea76) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:16.597312 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:16.599731 np0000000663 nova-compute[98103]: INFO os_vif [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:36:7f,bridge_name='br-int',has_traffic_filtering=True,id=b954427a-1edc-456a-a562-8652bcf5840e,network=Network(310d0f08-5e3e-4bc7-a491-3d7c91666d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb954427a-1e')
May 13 02:04:16.600139 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Deleting instance files /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8_del
May 13 02:04:16.601018 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Deletion of /opt/stack/data/nova/instances/e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8_del complete
May 13 02:04:16.620538 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7be413eb9340d1af627622a3e917fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32377a41c4fc4e2781fdff3229fc3395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:04:16.938280 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 02:04:16.939357 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:16.939616 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:16.939730 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:16.939979 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.023209 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:04:17.111850 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Took 1.45 seconds to destroy the instance on the hypervisor.
May 13 02:04:17.115473 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:17.116078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:17.116232 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:17.116504 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.273396 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Successfully created port: 536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:04:17.366535 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.447686 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.524826 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:04:17.532240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:17.714733 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.715001 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:17.994640 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Successfully updated port: 536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:04:18.031076 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Booting with blank volume at /dev/vda
May 13 02:04:18.107047 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:18.107703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:18.107703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:18.107703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:18.108025 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:18.108025 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-2afa5917-209f-403f-b7ae-2caa7e9e81f8 req-999d86c7-b613-4144-a5dc-eb08b7ea957b service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state active and task_state resize_migrating.
May 13 02:04:18.125799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:18.126026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] Acquiring lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:18.126236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:18.126382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:18.126568 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] No waiting events found dispatching network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:18.126724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0587a5c1-d09f-4c23-ac0d-c0fd753e1fa7 req-ab67dbe0-bca5-41dc-b97a-06ec08c11096 service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-unplugged-772c3f74-65ab-4239-a55b-7ecf08c6bc79 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:18.174018 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:18.174303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] Acquiring lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:18.174931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:18.175387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:18.175507 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] No waiting events found dispatching network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:18.176164 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d824d16f-daf1-48c4-81c0-984ba85b3fbb req-e973c130-9959-4996-8abd-b1a7e03214eb service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-unplugged-b954427a-1edc-456a-a562-8652bcf5840e for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:18.313808 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Port 11134c0d-5266-455d-9b09-07953c0b92c2 binding to destination host np0000000663 is already ACTIVE {{(pid=98103) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 02:04:18.497274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:18.497434 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:18.497641 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:18.508344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:18.524116 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:18.763345 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:19.026154 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Took 2.09 seconds to deallocate network for instance.
May 13 02:04:19.096155 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:19.263821 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Took 2.15 seconds to deallocate network for instance.
May 13 02:04:19.293503 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:19.326044 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:04:19.341671 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:19.341939 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:19.342010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:19.505661 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:19.537748 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:19.537931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:19.773153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:20.008366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:20.008697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance network_info: |[{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:04:20.122229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:20.191601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:20.191601 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:20.212112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fc27e245-9fc9-429c-860a-4fc9200de393 req-f3f78fd7-a3a1-4e06-884e-1f4bedb3b16e service nova] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Received event network-vif-deleted-772c3f74-65ab-4239-a55b-7ecf08c6bc79 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:20.212331 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fc27e245-9fc9-429c-860a-4fc9200de393 req-f3f78fd7-a3a1-4e06-884e-1f4bedb3b16e service nova] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Received event network-vif-deleted-b954427a-1edc-456a-a562-8652bcf5840e {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:20.261104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-changed-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:20.261104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Refreshing instance network info cache due to event network-changed-536a799f-3ef3-43a5-bc46-33adc66429e1. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:20.261220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] Acquiring lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:20.261288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] Acquired lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:20.261393 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Refreshing network info cache for port 536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:20.315609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:20.363799 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:20.459024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:20.459240 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:20.459405 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:20.693496 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:20.765079 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:20.961987 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:20.993645 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.000532431000010547 future=<Future at 0x705c6c62c110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:20.994612 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Emitting event <LifecycleEvent: 1778637845.9929574, 90b73edb-7021-4d08-90fe-4cd3f5678c7c => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:20.994897 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:20.995520 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] VM Stopped (Lifecycle Event)
May 13 02:04:20.996853 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.611169710000013 future=<Future at 0x705c6c6c4c80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:20.997040 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.610926518000042 future=<Future at 0x705c6c6c4c80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:21.165489 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:21.202778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.665s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:21.204629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.432s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:21.267413 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Deleted allocations for instance a3598ffd-b2b9-472d-bc0b-187a6f5ffae6
May 13 02:04:21.425166 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updated VIF entry in instance network info cache for port 536a799f-3ef3-43a5-bc46-33adc66429e1. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:04:21.425639 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:21.460348 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:21.501120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 90b73edb-7021-4d08-90fe-4cd3f5678c7c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:21.569600 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:21.584332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:21.600249 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:21.610048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:21.646075 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:21.650511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:21.650511 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:21.668648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:21.670236 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe21:f645', 'fe80::fc16:3eff:fe1d:2a66'] 
May 13 02:04:21.670384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:21.670484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:21.670681 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:21.670841 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating existing volume attachment record: 66038d4b-5b07-44de-8e59-48a2f16f6b7a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:04:21.843113 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:21.931008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9f601ebe-03c3-4781-9cf7-35c3d6e9a5a1 req-0d5ab8c1-ca5e-484d-baa9-2e81f14100ef service nova] Releasing lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:21.972074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:21.972074 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:22.149360 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:22.297995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b71977d-5048-4ed5-be6c-837ec8262669 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "a3598ffd-b2b9-472d-bc0b-187a6f5ffae6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.308s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:22.475235 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:22.659536 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:22.675580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:22.695741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:22.702771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:22.734927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:22.735222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:22.747992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:22.751776 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fec0:b72c', 'fe80::9c98:ecff:fea2:3ed1', 'fe80::fc16:3eff:feaa:b32f', 'fe80::fc16:3eff:fecf:18a4', 'fe80::fc16:3eff:fe2e:890', 'fe80::fc16:3eff:fea7:6e1e', 'fe80::5880:a1ff:fe0d:7a12', 'fe80::fc16:3eff:fe03:c62c', 'fe80::fc16:3eff:fea3:d354', 'fe80::2001:cff:fe1a:a922', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe21:f645', 'fe80::fc16:3eff:fe1d:2a66'] 
May 13 02:04:22.751776 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:22.752035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:22.752358 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:22.985327 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.781s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:23.080615 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Deleted allocations for instance e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8
May 13 02:04:23.803035 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:04:23.805025 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:04:23.805347 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Creating image(s)
May 13 02:04:23.805950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:04:23.806059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:23.806324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:23.806565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:23.806752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:23.807302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start _get_guest_xml network_info=[{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd8e796d1-f442-4a33-935b-863c6340bbca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'serial': 'd5e17c66-f6eb-498a-9579-05dc2395134e'}, 'attachment_id': '66038d4b-5b07-44de-8e59-48a2f16f6b7a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:23.810211 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:23.813566 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000', uuid='d8e796d1-f442-4a33-935b-863c6340bbca'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637863.8126843) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:23.815692 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:23.816054 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:23.817118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:23.817292 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:23.819823 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:23.820240 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:23.820429 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:23.820565 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:23.820765 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:23.820902 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:23.821060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:23.821696 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:23.821852 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:23.822017 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:23.822215 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:23.822431 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:23.840565 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:23.840932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:23.841132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:23.841769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:23.841954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:23.852748 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:23.853188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:23.853383 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:23.853963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:23.854506 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:23.854728 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:23.867119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:23.867119 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:23.869635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:23.869635 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:23.886639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e] added
May 13 02:04:23.886639 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:23.886639 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:23.886639 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:23.886639 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:23.886639 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:23.886639 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:23.887087 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:23.887161 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:23.887357 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e] added
May 13 02:04:23.890654 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:23.890654 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:23.890654 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:23.906799 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Starting finish_migration {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 02:04:23.907624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:04:23.907733 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Creating image(s)
May 13 02:04:23.908717 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:24.009349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:24.009802 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:04:24.010057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:24.097399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6005b3b-3a5b-4206-88cc-3b2a4292dd84 tempest-TestMultiAttachVolumeSwap-17294794 tempest-TestMultiAttachVolumeSwap-17294794-project-member] Lock "e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.976s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:24.115025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:24.115613 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Cannot resize image /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:04:24.222896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:24.223980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:24.618906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:04:24.619126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Ensure instance console log exists: /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:24.619525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:24.619736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:24.619928 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:24.624683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start _get_guest_xml network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '2973c226-2c35-4da1-bd21-cddd0fcbbb34', 'attached_at': '2026-05-13T02:04:23.000000', 'detached_at': '', 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'serial': '8976cef6-0dd2-4a42-822e-4ca6754debd5'}, 'attachment_id': '94441930-c582-48f2-97f9-615157174f65', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:24.627764 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:24.629378 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1897002082', uuid='2973c226-2c35-4da1-bd21-cddd0fcbbb34'), owner=OwnerMeta(userid='7b7888f9faa44571ba756dfc65e033d5', username='tempest-ServerActionsTestOtherB-810999869-project-member', projectid='45aa68ef76ab4ec78cb3d85b6cf5dc57', projectname='tempest-ServerActionsTestOtherB-810999869'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637864.6288376) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:24.630598 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:24.631339 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:24.631965 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:24.632246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:24.633993 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:24.635755 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:24.636148 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:24.636364 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:24.636574 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:24.636729 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:24.636875 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:24.637103 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:24.637260 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:24.637571 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:24.637776 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:24.637950 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:24.654882 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:24.726973 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:04:24.731278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config --force-share --output=json" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:24.731979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:24.732283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:24.733018 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:24.733481 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:24.734061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:24.734258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:24.888029 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:24.891000 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:24.902365 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:24.902365 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:24.914239 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:24.914239 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:24.921287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:24.931125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.941401 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.941787 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.950736 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:24.951218 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:24.990201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.40.100,3260]
May 13 02:04:24.990201 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.40.100,3260] successful.
May 13 02:04:24.990201 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:24.997749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.50.100,3260]
May 13 02:04:24.997749 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.50.100,3260] successful.
May 13 02:04:24.997749 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:25.006162 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:25.010624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.029474 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.029809 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:25.030149 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:25.030322 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:25.031847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('15', '-', '-', 0) found on session 19 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:25.031996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.036713 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:25.037122 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:25.037335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:25.037335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:25.038649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('16', '-', '-', 0) found on session 20 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:25.038770 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:25.054837 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 19 and hctl ['15', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:25.063949 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 20 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:25.064497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:25.128121 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:25.309256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:25.309610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:25.313892 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:04:25.314062 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Claim successful on node np0000000663
May 13 02:04:26.055508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 19 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:26.055508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:26.604649 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Found WWN 33000000094b3b32e for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000094b3b32e', 'path': '/dev/dm-6', 'multipath_id': '33000000094b3b32e'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094b3b32e', 'path': '/dev/dm-6', 'multipath_id': '33000000094b3b32e'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.142s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:26.877236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:26.893111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:26.894763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:26.897188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:26.897426 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:26.898226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:26.901823 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:26.914982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:26.914982 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:26.923053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:26.923053 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:26.930787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:04:26.930787 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:26.930787 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:26.930787 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:26.930787 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:26.930787 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:26.930787 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:26.931112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:26.931317 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:26.931519 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:26.932972 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:26.933294 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:26.936533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:04:26.936533 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:26.936533 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:26.936533 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:26.936533 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:26.936533 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:26.936533 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:26.936944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:26.936944 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:26.937176 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:27.398427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-210277000',id=13,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-py4iqc2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:18Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=d8e796d1-f442-4a33-935b-863c6340bbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:27.398427 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:27.400022 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:27.401197 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:27.437179 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:27.904474 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <uuid>d8e796d1-f442-4a33-935b-863c6340bbca</uuid>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <name>instance-0000000d</name>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-210277000</nova:name>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:23</nova:creationTime>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         <nova:port uuid="536a799f-3ef3-43a5-bc46-33adc66429e1">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="serial">d8e796d1-f442-4a33-935b-863c6340bbca</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="uuid">d8e796d1-f442-4a33-935b-863c6340bbca</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <alias name="ua-d5e17c66-f6eb-498a-9579-05dc2395134e"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-6"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <serial>d5e17c66-f6eb-498a-9579-05dc2395134e</serial>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:25:16:8e"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <target dev="tap536a799f-3e"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/console.log" append="off"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:27.904474 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Preparing to wait for external event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-210277000',id=13,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-py4iqc2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:18Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=d8e796d1-f442-4a33-935b-863c6340bbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:27.907701 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:27.908619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.908619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:27.908619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:27.909784 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.909967 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a25326e-783a-5010-b98a-5029fe1c05e5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:27.910939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.911988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:27.912488 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.916026 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.916388 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap536a799f-3e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:27.916945 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap536a799f-3e, col_values=(('qos', UUID('60cd4a88-b354-4d30-810d-a07fbe240f2c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:27.917294 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap536a799f-3e, col_values=(('external_ids', {'iface-id': '536a799f-3ef3-43a5-bc46-33adc66429e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:16:8e', 'vm-uuid': 'd8e796d1-f442-4a33-935b-863c6340bbca'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:27.918811 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.920182 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:27.926582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:27.927465 np0000000663 nova-compute[98103]: INFO os_vif [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e')
May 13 02:04:27.932120 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:27.937620 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:27.946648 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.637s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:27.947086 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:27.951158 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:27.951158 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:27.961978 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:27.961978 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:27.971503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:27.983872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:27.991929 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:27.992516 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.006325 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.007238 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:28.072694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:04:28.072694 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:04:28.072694 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:28.093223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:28.112720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:28.117126 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:28.117126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:28.121453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('18', '-', '-', 0) found on session 22 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:28.123176 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:28.141436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 22 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:28.141436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:28.453810 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:04:28.455083 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:04:28.455499 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:28.455847 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:28.550891 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41217929cd464e84bb0eff3c24cf366b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74938bb5b50b4802872e24928d9b173a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:04:28.650271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:28.962035 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:04:29.064287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:04:29.064287 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:04:29.064287 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:29.081903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:29.104407 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:29.104897 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:29.105548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.208s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:29.105548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:29.106359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('17', '-', '-', 0) found on session 21 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:29.106586 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:29.137772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 21 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:29.137772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:29.446288 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:29.446548 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:29.446707 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:25:16:8e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:29.447234 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Using config drive
May 13 02:04:29.466682 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:04:29.482433 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Successfully created port: 0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:04:29.915556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Found WWN 330000000236426d5 for multipath device dm-7 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:29.915954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:29.916214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== connect_volume: return (5181ms) {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-7', 'multipath_id': '330000000236426d5'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:29.916858 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-7', 'multipath_id': '330000000236426d5'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:29.954346 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:30.130773 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.424987 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:13Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:30.425221 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:30.425858 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:30.433387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <uuid>2973c226-2c35-4da1-bd21-cddd0fcbbb34</uuid>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <name>instance-00000008</name>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <memory>262144</memory>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherB-server-1897002082</nova:name>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:24</nova:creationTime>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.micro" id="84">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:memory>256</nova:memory>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:user uuid="7b7888f9faa44571ba756dfc65e033d5">tempest-ServerActionsTestOtherB-810999869-project-member</nova:user>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:project uuid="45aa68ef76ab4ec78cb3d85b6cf5dc57">tempest-ServerActionsTestOtherB-810999869</nova:project>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         <nova:port uuid="11134c0d-5266-455d-9b09-07953c0b92c2">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="serial">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="uuid">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <alias name="ua-8976cef6-0dd2-4a42-822e-4ca6754debd5"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-7"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <serial>8976cef6-0dd2-4a42-822e-4ca6754debd5</serial>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:64:87:88"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <target dev="tap11134c0d-52"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/console.log" append="off"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:30.433387 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:30.435753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:13Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:30.435753 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-776637087-network", "vif_mac": "fa:16:3e:64:87:88"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:30.436215 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:30.436522 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:30.440427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.440427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:30.440427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:30.440427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.441720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55c3579d-fde6-5298-86c1-521c71b511ee', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:30.446020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.447229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:30.453162 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.456821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.456821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11134c0d-52, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:30.456821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11134c0d-52, col_values=(('qos', UUID('761fe8a1-6a08-4719-9f02-c670473ab452')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:30.457039 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11134c0d-52, col_values=(('external_ids', {'iface-id': '11134c0d-5266-455d-9b09-07953c0b92c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:87:88', 'vm-uuid': '2973c226-2c35-4da1-bd21-cddd0fcbbb34'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:30.458030 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.460504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:30.472043 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:30.473251 np0000000663 nova-compute[98103]: INFO os_vif [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:04:30.476888 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:04:30.477967 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:04:30.478232 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Creating image(s)
May 13 02:04:30.478718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:30.478860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:30.481358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:30.481958 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:30.486372 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:30.488375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.579411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.579411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:30.579411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:30.581463 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:30.588936 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:30.589289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.612250 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.004152326999928846 future=<Future at 0x705c6c6c4c80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.613004 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.614854 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Emitting event <LifecycleEvent: 1778637855.6079018, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:30.615500 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.26433569400001034 future=<Future at 0x705c801a1760 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.615750 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Stopped (Lifecycle Event)
May 13 02:04:30.620129 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.25961409299998195 future=<Future at 0x705c801a1760 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.657114 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Creating config drive at /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config
May 13 02:04:30.666166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34yci_mw {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.682126 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Successfully updated port: 0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:04:30.701808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.702564 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.718997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34yci_mw" returned: 0 in 0.052s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.729210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-changed-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:30.729412 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Refreshing instance network info cache due to event network-changed-0506ec99-0250-456f-a8ca-14f0fecec31b. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:30.729725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] Acquiring lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:30.729861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] Acquired lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:30.730072 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Refreshing network info cache for port 0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:30.759664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk 1073741824" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.760291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:30.760893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.848339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.848747 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:04:30.848966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:30.880857 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0010828930001025583 future=<Future at 0x705c801a1760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.881954 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778637855.8795772, a3598ffd-b2b9-472d-bc0b-187a6f5ffae6 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:30.882222 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] VM Stopped (Lifecycle Event)
May 13 02:04:30.885084 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.885084 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.16708892200017544 future=<Future at 0x705c6c7c8410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.885084 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.16698573900021074 future=<Future at 0x705c6c7c8410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:30.943150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:30.943606 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Cannot resize image /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:04:30.943977 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:04:30.944211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Ensure instance console log exists: /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:30.944704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:30.944903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:30.945085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:31.054351 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.002059724999980972 future=<Future at 0x705c6c7c8410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:31.055360 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Emitting event <LifecycleEvent: 1778637856.0519395, e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:31.055540 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] VM Stopped (Lifecycle Event)
May 13 02:04:31.057448 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:31.124212 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:31.126236 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:31.186397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:31.233867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:31.238715 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:31.272358 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:31.337588 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:31.365937 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:31.384053 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:31.386814 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-15d61e01-bbe7-4ce7-9535-d35d6b58572e tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: a3598ffd-b2b9-472d-bc0b-187a6f5ffae6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:31.391356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:31.560323 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0298f0b6-cc1c-4927-a8ae-78e8bda32485 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e1b461ca-d1fe-4a3f-afd6-f5084dd95ca8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:31.628901 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 02:04:31.811393 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:31.997377 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:31.997536 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:31.997636 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:31.997731 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] No VIF found with MAC fa:16:3e:64:87:88, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:31.998268 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Using config drive
May 13 02:04:32.182347 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637872.1811159, d8e796d1-f442-4a33-935b-863c6340bbca => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:32.182347 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Started (Lifecycle Event)
May 13 02:04:32.314726 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-578501a0-73e3-4091-8734-cc23a196201f req-49ead086-9b04-4560-a5cc-31cd8356ad3c service nova] Releasing lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:32.315266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquired lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:32.315736 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:32.545482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:32.575519 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:32.679891 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:32.687110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:32.697889 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637872.6962364, d8e796d1-f442-4a33-935b-863c6340bbca => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:32.697889 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Paused (Lifecycle Event)
May 13 02:04:32.828712 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:32.831494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:32.831722 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:32.831955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:32.832139 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Processing event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:32.832763 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:32.833962 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:32.834071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:32.837114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:32.837114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:32.837114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:32.837114 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f5e0a853-ad39-47a1-8b97-ce447ffbc895 req-64440036-06ed-45f6-86e8-fb97fa5268c1 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state building and task_state spawning.
May 13 02:04:32.847431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:04:32.851032 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance spawned successfully.
May 13 02:04:32.852109 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:04:32.902119 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:32.907497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:32.935394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:33.010121 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:33.199460 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:33.202713 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637873.202268, d8e796d1-f442-4a33-935b-863c6340bbca => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:33.202868 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Resumed (Lifecycle Event)
May 13 02:04:33.227603 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:33.365941 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.366027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.366411 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.366757 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.367107 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.367490 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:33.481059 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Updating instance_info_cache with network_info: [{"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:33.496678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:33.535377 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:33.538149 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance running successfully.
May 13 02:04:33.539752 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Failed to set time: agent not configured {{(pid=98103) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 02:04:33.540010 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-980032ee-ab62-49dc-a4bd-333b41f76261 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] finish_migration finished successfully. {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 02:04:33.705120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:33.706844 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:33.873304 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Took 10.07 seconds to spawn the instance on the hypervisor.
May 13 02:04:33.873561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:33.985921 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Releasing lock "refresh_cache-7c63e8c4-433f-4d58-9464-9f3e4ea486f0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:33.986310 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance network_info: |[{"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:04:33.988115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Start _get_guest_xml network_info=[{"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:33.990231 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:33.991665 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1267321414', uuid='7c63e8c4-433f-4d58-9464-9f3e4ea486f0'), owner=OwnerMeta(userid='41217929cd464e84bb0eff3c24cf366b', username='tempest-DeleteServersTestJSON-532119916-project-member', projectid='74938bb5b50b4802872e24928d9b173a', projectname='tempest-DeleteServersTestJSON-532119916'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637873.9912634) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:33.992566 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:33.993021 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:33.993867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:33.994034 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:33.995027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:33.995320 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:33.995558 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:33.995618 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:33.995738 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:33.995827 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:33.995914 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:33.996052 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:33.996161 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:33.996265 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:33.996379 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:33.996528 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:34.009349 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1267321414',display_name='tempest-DeleteServersTestJSON-server-1267321414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-deleteserverstestjson-server-1267321414',id=14,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74938bb5b50b4802872e24928d9b173a',ramdisk_id='',reservation_id='r-m1c2gcbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-532119916',owner_user_name='tempest-DeleteServersTestJSON-532119916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:29Z,user_data=None,user_id='41217929cd464e84bb0eff3c24cf366b',uuid=7c63e8c4-433f-4d58-9464-9f3e4ea486f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:34.009765 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converting VIF {"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:34.010503 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:34.011343 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:34.210935 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:04:34.211481 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637874.2110283, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:34.211481 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Resumed (Lifecycle Event)
May 13 02:04:34.304832 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.389895 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Took 21.31 seconds to build instance.
May 13 02:04:34.516915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <uuid>7c63e8c4-433f-4d58-9464-9f3e4ea486f0</uuid>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <name>instance-0000000e</name>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:name>tempest-DeleteServersTestJSON-server-1267321414</nova:name>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:33</nova:creationTime>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:user uuid="41217929cd464e84bb0eff3c24cf366b">tempest-DeleteServersTestJSON-532119916-project-member</nova:user>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:project uuid="74938bb5b50b4802872e24928d9b173a">tempest-DeleteServersTestJSON-532119916</nova:project>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         <nova:port uuid="0506ec99-0250-456f-a8ca-14f0fecec31b">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="serial">7c63e8c4-433f-4d58-9464-9f3e4ea486f0</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="uuid">7c63e8c4-433f-4d58-9464-9f3e4ea486f0</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.config"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:c0:b9:6c"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <target dev="tap0506ec99-02"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/console.log" append="off"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:34.516915 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Preparing to wait for external event network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1267321414',display_name='tempest-DeleteServersTestJSON-server-1267321414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-deleteserverstestjson-server-1267321414',id=14,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74938bb5b50b4802872e24928d9b173a',ramdisk_id='',reservation_id='r-m1c2gcbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-532119916',owner_user_name='tempest-DeleteServersTestJSON-532119916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:29Z,user_data=None,user_id='41217929cd464e84bb0eff3c24cf366b',uuid=7c63e8c4-433f-4d58-9464-9f3e4ea486f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converting VIF {"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:34.523172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:34.525497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.525497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a2aca67-3f03-5576-8cbc-f681cba5e52b', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:34.525497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.525879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:34.529756 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.530706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.530854 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0506ec99-02, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:34.531201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0506ec99-02, col_values=(('qos', UUID('70fa973d-0a94-4484-ab6f-4ee7d105ef93')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:34.531347 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0506ec99-02, col_values=(('external_ids', {'iface-id': '0506ec99-0250-456f-a8ca-14f0fecec31b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:b9:6c', 'vm-uuid': '7c63e8c4-433f-4d58-9464-9f3e4ea486f0'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:34.532359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.535054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:34.539282 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:34.540253 np0000000663 nova-compute[98103]: INFO os_vif [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02')
May 13 02:04:34.718049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:34.723571 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:34.895279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c9ce4fa-a77a-4a8e-9889-e2ce004f9cdc tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.826s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:34.940252 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:34.940252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:34.940252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:34.940389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:34.940479 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:34.940600 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state resized and task_state None.
May 13 02:04:34.940686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:34.940818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:34.940934 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:34.941147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:34.943172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:34.943448 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f14891f2-9767-4469-ab3d-666b1f3320f5 req-1529ce5a-ada3-486d-8277-7905045ba237 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state resized and task_state None.
May 13 02:04:35.133591 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:35.230966 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637875.230515, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:35.231276 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Started (Lifecycle Event)
May 13 02:04:35.555464 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:35.708749 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:35.708976 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:35.709357 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:35.733954 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:35.736656 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:35.783874 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Port 11134c0d-5266-455d-9b09-07953c0b92c2 binding to destination host np0000000663 is already ACTIVE {{(pid=98103) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 02:04:35.784024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:35.784413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:35.784413 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:36.073754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:36.073754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:36.073754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No VIF found with MAC fa:16:3e:c0:b9:6c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:36.076887 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Using config drive
May 13 02:04:36.238957 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 13 02:04:36.287207 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:36.379049 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Rescuing
May 13 02:04:36.379049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:36.379049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:36.379049 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:36.588662 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:36.781222 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Creating config drive at /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.config
May 13 02:04:36.788120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptyqhdq32 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:36.812142 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:36.848789 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptyqhdq32" returned: 0 in 0.063s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:36.884122 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:37.108583 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:37.420512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.460701 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.598118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.611684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:37.792175 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:37.828740 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.833613 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.836650 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.865342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:37.916038 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4369fcd7-97e3-43a9-86cc-695331bf2053 req-62458f47-4742-44a5-9341-d433062a9eef service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:37.916333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4369fcd7-97e3-43a9-86cc-695331bf2053 req-62458f47-4742-44a5-9341-d433062a9eef service nova] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:37.916516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4369fcd7-97e3-43a9-86cc-695331bf2053 req-62458f47-4742-44a5-9341-d433062a9eef service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:37.916678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4369fcd7-97e3-43a9-86cc-695331bf2053 req-62458f47-4742-44a5-9341-d433062a9eef service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:37.916821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4369fcd7-97e3-43a9-86cc-695331bf2053 req-62458f47-4742-44a5-9341-d433062a9eef service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Processing event network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:38.067308 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:38.119720 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Creating tmpfile /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/tmpf5tzfcnn to verify with other compute node that the instance is on the same shared storage. {{(pid=98103) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 13 02:04:38.120115 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:04:38.523117 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637878.5223978, 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:38.523671 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:38.524524 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] VM Started (Lifecycle Event)
May 13 02:04:38.526600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:04:38.528624 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance spawned successfully.
May 13 02:04:38.529416 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:04:38.571188 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:38.653573 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.664201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.697117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.710123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.713206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.736244 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.763127 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.961653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:38.972893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.010444 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance destroyed successfully.
May 13 02:04:39.010444 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'resources' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:39.031219 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:39.038479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.038479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.039243 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.040695 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:39.040695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.041390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.042025 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:39.512613 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:34Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:39.512816 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:39.513519 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:39.513783 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:39.515605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.515605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11134c0d-52, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:39.518182 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.519220 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:39.522250 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.522250 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=761fe8a1-6a08-4719-9f02-c670473ab452) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:39.525638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.525638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:39.526556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:39.533215 np0000000663 nova-compute[98103]: INFO os_vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:04:39.534380 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:39.535921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:39.535921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:39.535921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:39.535921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:39.535921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:39.546919 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:04:39.547270 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637879.5470288, 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:39.547457 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] VM Paused (Lifecycle Event)
May 13 02:04:39.550111 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Took 9.07 seconds to spawn the instance on the hypervisor.
May 13 02:04:39.551376 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:39.570667 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:39.571084 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '22'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:39.571084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '22')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:39.573491 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '21')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:39.573544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7949a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:39.573814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:39.574068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flush multipath device 330000000236426d5 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:39.607273 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:39.654080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:39.696555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:39.696788 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:39.698315 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:39.713905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:39.714124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:39.727148 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.764316 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:04:39.764316 np0000000663 nova-compute[98103]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:04:39.764316 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.782773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.795947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.830893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:04:39.830893 np0000000663 nova-compute[98103]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:04:39.830893 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.849961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:39.849961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:39.849961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== disconnect_volume: return (314ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:39.849961 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:40.046075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:40.046458 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:40.046508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:40.046592 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:40.046698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] No waiting events found dispatching network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:40.046803 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received unexpected event network-vif-plugged-0506ec99-0250-456f-a8ca-14f0fecec31b for instance with vm_state active and task_state None.
May 13 02:04:40.046902 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:40.047025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:40.047191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:40.047326 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:40.047412 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:40.047528 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state resized and task_state resize_reverting.
May 13 02:04:40.047619 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:40.047757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:40.047916 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:40.048029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:40.048154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:40.048254 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3a2dfa24-86bd-4bd1-9cef-676db220e159 req-2613ef35-9ced-4f28-bbcc-097141aceeda service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state resized and task_state resize_reverting.
May 13 02:04:40.052871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:40.054853 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637880.0546446, 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:40.054980 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] VM Resumed (Lifecycle Event)
May 13 02:04:40.069234 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Took 14.84 seconds to build instance.
May 13 02:04:40.140530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.219081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.227507 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.244134 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.328507 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.379772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.385786 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.520838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.533388 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:40.543674 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance destroyed successfully.
May 13 02:04:40.545502 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'numa_topology' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:40.557277 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:40.562041 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:40.573462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e4b9304-f883-4c05-a2a0-87e2fc8bf24b tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.349s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:40.631886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:40.632083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:40.632326 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:40.632521 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:40.634349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:40.636462 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Terminating instance
May 13 02:04:41.008623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:41.008623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:41.051951 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Attempting a stable device rescue
May 13 02:04:41.064456 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999703998999848 future=<Future at 0x705c6c2b1c70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:41.065623 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99975241900006 future=<Future at 0x705c6c62eb70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:41.066283 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997818472000063 future=<Future at 0x705c6c2b1c70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:41.066447 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997707165000065 future=<Future at 0x705c6c2b1c70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:41.146921 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:04:41.149067 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:41.155373 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:04:41.155478 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Creating image(s)
May 13 02:04:41.156130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:41.158077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:41.158077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:41.158077 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:41.182677 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:41.185874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:41.205088 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:41.316009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:41.329307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:41.496866 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999708068000018 future=<Future at 0x705c6c2bd790 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:41.499733 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Instance destroyed successfully.
May 13 02:04:41.501561 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'resources' on Instance uuid e2a3610f-9e9b-41d1-a3ba-96ded5816117 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:41.512753 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'migration_context' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:41.662778 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:41.662778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "4c7f662a07850d6bec5ec47b08e958b26a645754" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:41.662778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4c7f662a07850d6bec5ec47b08e958b26a645754" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:41.932644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:41.932858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:41.933080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:41.933301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:41.933462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:41.942762 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Terminating instance
May 13 02:04:42.005130 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1290694761',display_name='tempest-AttachVolumeNegativeTest-server-1290694761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1290694761',id=11,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBblkPtWayCrz5ZEV4gthqJvTQxOAjSYCgLh0ZOk2GjOlOmnSZYSYDW6FRWE2gyJwGP/FmP7tpWb1B9R4KKU3wsGyzLXoq1tBfXUsW9Kf2AwwtHPoqG3YTLdMfigm/r7uw==',key_name='tempest-keypair-827144497',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-l3gn6167',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=e2a3610f-9e9b-41d1-a3ba-96ded5816117,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:42.005274 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "address": "fa:16:3e:21:f6:45", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf9aaa56-b5", "ovs_interfaceid": "df9aaa56-b5c8-4e32-856f-e44e6e3110e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:42.005976 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:42.007263 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:42.009181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.009181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf9aaa56-b5, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:42.013650 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:42.018249 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.019752 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.019942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37f0371c-187b-4463-9f6e-2a3fb0501c95) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:42.020778 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Object Instance<2973c226-2c35-4da1-bd21-cddd0fcbbb34> lazy-loaded attributes: resources,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:42.024543 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:42.027310 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.030347 np0000000663 nova-compute[98103]: INFO os_vif [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:f6:45,bridge_name='br-int',has_traffic_filtering=True,id=df9aaa56-b5c8-4e32-856f-e44e6e3110e2,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf9aaa56-b5')
May 13 02:04:42.030347 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Deleting instance files /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117_del
May 13 02:04:42.030495 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Deletion of /opt/stack/data/nova/instances/e2a3610f-9e9b-41d1-a3ba-96ded5816117_del complete
May 13 02:04:42.142029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.188085 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:42.188085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.188085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.190700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:42.191332 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:42.191332 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state active and task_state rescuing.
May 13 02:04:42.191544 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:42.191699 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.191864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state active and task_state rescuing.
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] No waiting events found dispatching network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Acquiring lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] No waiting events found dispatching network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:42.193612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5839679-570d-46ce-b7fb-f53c1ce19975 req-6b21d883-60b3-4432-8806-0a73c053725f service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-unplugged-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:42.321909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.322085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.453477 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:42.482325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.491613 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.510293 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.513747 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.514239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:42.514648 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.530467 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.554214 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.559071 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:04:42.560478 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.562272 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:42.563024 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:42.563024 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:42.563485 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:42.628132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.638855 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.part --force-share --output=json" returned: 0 in 0.123s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:42.638855 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] 7a96542e-7fa0-441c-937c-6cd971e30b6c was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:04:42.639322 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:04:42.639644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.part /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:42.717979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.741675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.748571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.749029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.part /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.converted" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:42.759842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:42.798857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.815471 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:42.818781 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.829041 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lazy-loading 'flavor' on Instance uuid 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:42.852771 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.861860 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:42.862364 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:42.883908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754.converted --force-share --output=json" returned: 0 in 0.124s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:42.884608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4c7f662a07850d6bec5ec47b08e958b26a645754" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.223s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:42.885028 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.891275 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.893017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "4c7f662a07850d6bec5ec47b08e958b26a645754" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:42.893528 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4c7f662a07850d6bec5ec47b08e958b26a645754" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:42.893881 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.898866 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:42.899533 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:42.914509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.958365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:42.985943 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.023510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754 --force-share --output=json" returned: 0 in 0.124s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:43.024236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754,backing_fmt=raw /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:43.053677 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.099855 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4c7f662a07850d6bec5ec47b08e958b26a645754,backing_fmt=raw /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:43.102715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4c7f662a07850d6bec5ec47b08e958b26a645754" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:43.102715 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'migration_context' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:43.152678 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999631645000136 future=<Future at 0x705c6c69d910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:43.158280 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Instance destroyed successfully.
May 13 02:04:43.159471 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lazy-loading 'resources' on Instance uuid 66b654d9-cad8-4b68-8ce5-30b605e35e0b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:43.369990 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:43.466689 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:43.466761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:43.466895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:43.467032 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:43.467686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:43.467856 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1caff63c-1fd7-40e1-bd29-4a1cdcd710d7 req-552fee6d-3085-4be9-90e1-3bec5c26f8ca service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:43.617896 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:43.618243 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:04:43.619182 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start _get_guest_xml network_info=[{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:25:16:8e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7a96542e-7fa0-441c-937c-6cd971e30b6c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, 'status': 'reserved', 'instance': 'd8e796d1-f442-4a33-935b-863c6340bbca', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'serial': 'd5e17c66-f6eb-498a-9579-05dc2395134e'}, 'attachment_id': '66038d4b-5b07-44de-8e59-48a2f16f6b7a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:43.619358 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:43.663822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:43.664117 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "073d3192-c5b8-4719-a274-cfb77eae1845", "address": "fa:16:3e:c0:b7:2c", "network": {"id": "1741e09c-e1b6-4e6a-8389-54b7ec4d16b6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1959568501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap073d3192-c5", "ovs_interfaceid": "073d3192-c5b8-4719-a274-cfb77eae1845", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:43.664747 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:43.664976 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:43.666960 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.669813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap073d3192-c5, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.669813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.669813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.705502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.706618 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.706756 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7c405c4f-b150-430c-a04f-606f245325de) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.708210 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.708731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.740851 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.744272 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:b7:2c,bridge_name='br-int',has_traffic_filtering=True,id=073d3192-c5b8-4719-a274-cfb77eae1845,network=Network(1741e09c-e1b6-4e6a-8389-54b7ec4d16b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap073d3192-c5')
May 13 02:04:43.746265 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:43.746542 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:43.746915 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:43.747087 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:43.748160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.748297 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf59acf5c-24, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.749190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.750698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.783374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.784761 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.788496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39aba0c2-e641-43fa-9645-6c817cb64aa0) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.788496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.788496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.821348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.826873 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:b3:2f,bridge_name='br-int',has_traffic_filtering=True,id=f59acf5c-2430-4923-a19c-85ad17c9c00d,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf59acf5c-24')
May 13 02:04:43.826873 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:43.826873 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:43.826873 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:43.826873 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:43.827684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.827986 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff5c373b-bd, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.830979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.841266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:43.859204 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.860226 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.860419 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f305c91-79e7-411d-87f3-f9b41c82b48f) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.861809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.861809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.885689 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:43.885839 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 02:04:43.892145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.897119 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:18:a4,bridge_name='br-int',has_traffic_filtering=True,id=ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapff5c373b-bd')
May 13 02:04:43.897119 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:43.897119 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:43.897119 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:43.897119 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:43.898642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.898852 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53755aee-e0, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.902449 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.903439 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.925234 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.927016 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.927325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3770f6b-743a-42e3-b236-88db2e19338a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.929410 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.929990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.951228 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:08:90,bridge_name='br-int',has_traffic_filtering=True,id=53755aee-e02b-4634-865f-27868f510ce5,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53755aee-e0')
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:43.957904 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.958415 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefb9d48d-84, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.959244 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.959992 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:43.978086 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.984224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.984224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec03f702-cbaa-4aed-8b77-dea8bd1f6b27) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:43.984508 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:43.985064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:44.003609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.007240 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:6e:1e,bridge_name='br-int',has_traffic_filtering=True,id=efb9d48d-84ac-40ba-96c4-a6744a886582,network=Network(325d69d7-6c8f-4cf3-8b49-6d17fdaf736e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefb9d48d-84')
May 13 02:04:44.008282 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:44.008661 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:44.009716 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:44.010416 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:44.010968 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.011373 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ad9866b-a0, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:44.013511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.013511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:44.024039 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.025254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.025254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30c8d510-fbf9-460c-b5b0-1d4930b0fe1c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:44.026683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.026683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:44.037190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.040204 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c6:2c,bridge_name='br-int',has_traffic_filtering=True,id=5ad9866b-a0bf-47d3-b9d0-494bcace2c6d,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ad9866b-a0')
May 13 02:04:44.040803 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-801908412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-801908412',id=7,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCowQYZCyznUnNfIU31TlQ6HWho37B/ZqEQiEDXAB/aIJbD7uTEyvzM+MoaP0CdgDeGfcSHw1LRVYLfQuJaa9pnOu9WwEj4Hbt2cdXl87VPzTcOrsMpJJKqWNSQAOaeFg==',key_name='tempest-keypair-1504533287',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f64cf62c02d24c7680e5ac91383a3afb',ramdisk_id='',reservation_id='r-jeovsfi6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1829891618',owner_user_name='tempest-TaggedBootDevicesTest-1829891618-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae7086d52195415d88c31888535909d4',uuid=66b654d9-cad8-4b68-8ce5-30b605e35e0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:44.040953 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converting VIF {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:44.041422 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:44.041651 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:44.042355 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.042540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1b61a3a-75, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:44.044068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.044068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:44.051159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.052401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.052729 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b9cebed-f372-4b68-a0ff-b872a8cbe350) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:44.053307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.054865 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:44.059349 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:44.062889 np0000000663 nova-compute[98103]: INFO os_vif [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:d3:54,bridge_name='br-int',has_traffic_filtering=True,id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023,network=Network(0e9c0226-f73d-467a-9562-fa10ccc3784a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b61a3a-75')
May 13 02:04:44.063982 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:44.064403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:44.064576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.064979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:44.065346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd06bc804-45a6-4cf1-95a8-0fa453dae250', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:44.065543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.096725 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250 (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.097187 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:44.097187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:44.097553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '3')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:44.098520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250', '4')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:44.101551 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6639c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:44.102050 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:44.102132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Flush multipath device 3300000002c8db553 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:44.121959 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:44.124043 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:44.126606 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000', uuid='d8e796d1-f442-4a33-935b-863c6340bbca'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:25:16:8e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637884.1261199) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:44.128766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:44.129231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:44.132237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:44.132237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:44.133669 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:44.134394 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:44.134394 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:44.134602 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:44.135246 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:44.135391 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:44.135548 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:44.135759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:44.135933 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:44.136146 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:44.136264 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:44.136406 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:44.136557 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:44.149296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:44.200484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:44.245995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:44.246185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:44.247209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:44.258955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:44.260079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:44.270118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.306410 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.40.100,3260]
May 13 02:04:44.306410 np0000000663 nova-compute[98103]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.40.100,3260] successful.
May 13 02:04:44.306410 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.320193 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:44.338756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.346661 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:44.351848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.352030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.352190 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.352347 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:44.352504 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:44.352627 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:44.352752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.352870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.352990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.354836 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:44.355649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-073d3192-c5b8-4719-a274-cfb77eae1845 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:44.355649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:44.355649 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.355827 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.356045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.356113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:44.356261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:44.356566 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:44.356566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.356771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.356989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.357077 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:44.359813 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f59acf5c-2430-4923-a19c-85ad17c9c00d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:44.360020 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:44.360232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.360760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.360934 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.361018 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:44.361193 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-87c6d0bb-8f0a-49b9-9f8b-a4ba1b4498e3 req-bd6ad910-4486-4492-bd13-f94ee1e88351 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:44.361892 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.385170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.378s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.390122 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:04:44.395078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] There are 0 instances to clean {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 02:04:44.396939 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:44.397869 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances with incomplete migration  {{(pid=98103) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 02:04:44.400344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.50.100,3260]
May 13 02:04:44.400344 np0000000663 nova-compute[98103]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-d06bc804-45a6-4cf1-95a8-0fa453dae250, portal: 192.168.50.100,3260] successful.
May 13 02:04:44.400344 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.428631 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.428988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:44.428988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== disconnect_volume: return (364ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:44.429085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:44.434854 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:44.435823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:44.435823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.438456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:44.438810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9775139-192b-4c7e-bdcc-173782b7561c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:44.439500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.477484 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:44.477484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '5')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:44.481503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c', '6')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:44.492512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c4f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:44.493642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:44.493642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Flush multipath device 33000000041c6a34c {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:44.529452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:44.575704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:44.633378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:44.634593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:44.635156 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:44.639258 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:44.652867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:44.652867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:44.653839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:44.674523 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.711717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.40.100,3260]
May 13 02:04:44.711717 np0000000663 nova-compute[98103]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.40.100,3260] successful.
May 13 02:04:44.711717 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.734304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.748950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.751292 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:44.752234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.752650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.753417 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:44.753933 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:44.754529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:44.755513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.780795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.50.100,3260]
May 13 02:04:44.780795 np0000000663 nova-compute[98103]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-f9775139-192b-4c7e-bdcc-173782b7561c, portal: 192.168.50.100,3260] successful.
May 13 02:04:44.780795 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.804342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.804905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:44.804905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== disconnect_volume: return (369ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:44.805133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:44.806840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.051s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:44.807111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:44.809513 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:44.809513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:44.809513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.821613 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.822250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:44.823538 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Took 2.26 seconds to deallocate network for instance.
May 13 02:04:44.826377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:44.826377 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:44.828516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:44.828777 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:44.843340 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:44.843340 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:44.850476 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:44.850476 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.860567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.864799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.874914 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('15', '0', '0', 0) found on session 19 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:44.874914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:44.885509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 19 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:44.886235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.888073 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:44.888310 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:44.888615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:44.888759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:44.889413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('16', '0', '0', 0) found on session 20 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:44.889661 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:44.900418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 20 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:44.900418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:44.903620 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:44.993073 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:44.993073 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:44.993073 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Attaching volume 0ba2f007-0687-4387-8c23-f398f471c374 to /dev/vdb
May 13 02:04:45.038925 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:45.051214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:45.077474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:45.111661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:45.112865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:45.121819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:45.122731 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fec0:b96c', 'fe80::246e:ebff:fe19:2929'] 
May 13 02:04:45.123065 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:45.123298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:45.123640 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:45.123980 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Updating existing volume attachment record: be136f70-91ce-493d-8106-6130e968cd2b {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:04:45.138738 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:45.338499 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:45.338881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:45.411598 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:45.541641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:45.542049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:45.543372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:45.543372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:45.543372 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:45.543607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:45.543607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:45.543607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:45.544605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:45.544605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:45.544605 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:45.544605 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:45.544965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Received event network-vif-deleted-df9aaa56-b5c8-4e32-856f-e44e6e3110e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:45.544965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:45.545308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:45.545466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:45.545585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:45.545697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:45.545955 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3d55dab-b138-4e76-bdcc-ca92c87a8975 req-cf5e1f4a-1432-4c08-8a88-16df60d70c4b service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:45.701463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:45.701910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:45.702137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:45.823412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:04:45.940714 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:45.941024 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:45.973916 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Swapping old allocation on dict_keys(['97b2898b-d3c3-45e4-a1d2-ef71603b8684']) held by migration ad0e139e-f468-4e4d-809a-2bf480830a90 for instance
May 13 02:04:46.065672 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Overwriting current allocation {'allocations': {'97b2898b-d3c3-45e4-a1d2-ef71603b8684': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 19}}, 'project_id': '45aa68ef76ab4ec78cb3d85b6cf5dc57', 'user_id': '7b7888f9faa44571ba756dfc65e033d5', 'consumer_generation': 1} on consumer 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 13 02:04:46.120369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:46.120580 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:46.141484 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:46.232395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:46.232703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquired lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:46.232896 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:46.405274 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:46.405274 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:46.406682 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.48 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:46.440454 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:46.440694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:46.440879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:46.441010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:46.441219 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:46.441395 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:46.441577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:46.442309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:46.442585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:46.442741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:46.442912 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:46.443116 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Acquiring lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] No waiting events found dispatching network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe8fe68f-3441-45d5-93bf-d4fb2dab6c78 req-81dc7ecd-2684-4ed6-aee1-1e0eed125b30 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-unplugged-efb9d48d-84ac-40ba-96c4-a6744a886582 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:46.446112 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:46.625264 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:04:46.734898 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:46.842362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Found WWN 33000000094b3b32e for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:46.842726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:46.842913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== connect_volume: return (2088ms) {'type': 'block', 'scsi_wwn': '33000000094b3b32e', 'path': '/dev/dm-6', 'multipath_id': '33000000094b3b32e'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:46.843063 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000094b3b32e', 'path': '/dev/dm-6', 'multipath_id': '33000000094b3b32e'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:46.843827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.035s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:46.844248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '31879686-1b3b-4707-9ca0-3c271de030bb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:46.844382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:46.871464 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:46.871796 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:46.871796 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '7')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:46.872682 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb', '8')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:46.873352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c801a8f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:46.873526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:46.873723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Flush multipath device 33000000047e8d34f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:46.907362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:46.954899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.616s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:46.960603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:47.014564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:47.014734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:47.015738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:47.026685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:47.026977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:47.029364 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Deleted allocations for instance e2a3610f-9e9b-41d1-a3ba-96ded5816117
May 13 02:04:47.041363 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.081140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.40.100,3260]
May 13 02:04:47.081140 np0000000663 nova-compute[98103]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.40.100,3260] successful.
May 13 02:04:47.081140 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.095790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.106068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.109668 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:47.143373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.50.100,3260]
May 13 02:04:47.143373 np0000000663 nova-compute[98103]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-31879686-1b3b-4707-9ca0-3c271de030bb, portal: 192.168.50.100,3260] successful.
May 13 02:04:47.143373 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.161503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.161761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:47.161908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] <== disconnect_volume: return (2353ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:47.162031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:47.162457 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Deleting instance files /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b_del
May 13 02:04:47.162936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.461s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:47.163237 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:47.163808 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Deletion of /opt/stack/data/nova/instances/66b654d9-cad8-4b68-8ce5-30b605e35e0b_del complete
May 13 02:04:47.183914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:47.184807 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:47.185481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:47.185812 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:47.186283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:47.186522 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:47.204041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:47.204041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:47.204041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:47.204041 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.206142 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:04:47.208329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:47.208329 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.208615 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Claim successful on node np0000000663
May 13 02:04:47.216156 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374] added
May 13 02:04:47.216156 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:47.216156 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:47.216156 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:47.216156 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:47.216156 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:47.216156 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.216548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:47.216808 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:47.216981 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:47.221667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374] added
May 13 02:04:47.221667 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:47.221667 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:47.221667 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:47.221667 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:47.221667 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:47.221667 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:47.222010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:47.222010 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:47.222232 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:47.263035 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:47.350454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-210277000',id=13,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:33Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-py4iqc2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:34Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=d8e796d1-f442-4a33-935b-863c6340bbca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:25:16:8e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:47.350823 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:25:16:8e"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:47.351530 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:47.353155 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:47.671519 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Took 5.22 seconds to destroy the instance on the hypervisor.
May 13 02:04:47.672323 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:47.672747 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:47.672858 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:47.673121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:47.764079 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Releasing lock "refresh_cache-2973c226-2c35-4da1-bd21-cddd0fcbbb34" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:47.764751 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:47.785205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:47.789786 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:47.806919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:47.849875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:47.850244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:47.856199 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:47.858164 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <uuid>d8e796d1-f442-4a33-935b-863c6340bbca</uuid>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <name>instance-0000000d</name>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-210277000</nova:name>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:44</nova:creationTime>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         <nova:port uuid="536a799f-3ef3-43a5-bc46-33adc66429e1">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="serial">d8e796d1-f442-4a33-935b-863c6340bbca</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="uuid">d8e796d1-f442-4a33-935b-863c6340bbca</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <alias name="ua-d5e17c66-f6eb-498a-9579-05dc2395134e"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-6"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <serial>d5e17c66-f6eb-498a-9579-05dc2395134e</serial>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <boot order="1"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:25:16:8e"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <target dev="tap536a799f-3e"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/console.log" append="off"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:47.858164 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:47.864532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:47.864532 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fec0:b96c', 'fe80::246e:ebff:fe19:2929'] 
May 13 02:04:47.864532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:47.864532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:47.864532 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:47.869284 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance destroyed successfully.
May 13 02:04:47.893622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:47.893622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:48.040527 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-340624bb-4b5b-4983-9544-9c40ce89cea5 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "e2a3610f-9e9b-41d1-a3ba-96ded5816117" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.408s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:48.217565 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:48.227218 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:48.230003 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:48.230003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:48.245004 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:48.245004 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.251324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.256359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.267455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.267455 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.267455 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.267455 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.267455 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:48.267640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.267640 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.267640 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.267640 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.267640 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.277603 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:48.303962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.40.100,3260]
May 13 02:04:48.303962 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.40.100,3260] successful.
May 13 02:04:48.303962 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.315876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.316917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.50.100,3260]
May 13 02:04:48.316917 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.50.100,3260] successful.
May 13 02:04:48.316917 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.330295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.338933 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.339248 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:48.339460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:48.339538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:48.341739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] HCTL ('7', '-', '-', 0) found on session 23 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:48.341739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:48.347987 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:48.347987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:48.349827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] HCTL ('8', '-', '-', 0) found on session 24 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:48.349827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:48.366443 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Searching for a device in session 23 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:48.366653 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:48.367568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Searching for a device in session 24 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:48.367733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:48.395933 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:04:48.883965 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:48.885208 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:48.885926 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:48.887132 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:48.887268 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:04:48.887562 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:48.919771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:48.920068 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:48.963024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:48.963397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:48.963609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:49.005998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Starting finish_revert_migration {{(pid=98103) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 13 02:04:49.025782 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start _get_guest_xml network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '2973c226-2c35-4da1-bd21-cddd0fcbbb34', 'attached_at': '2026-05-13T02:04:48.000000', 'detached_at': '', 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'serial': '8976cef6-0dd2-4a42-822e-4ca6754debd5'}, 'attachment_id': '617843f4-e201-49ab-9aa1-e16c054e06d1', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:49.028557 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:49.030158 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1897002082', uuid='2973c226-2c35-4da1-bd21-cddd0fcbbb34'), owner=OwnerMeta(userid='7b7888f9faa44571ba756dfc65e033d5', username='tempest-ServerActionsTestOtherB-810999869-project-member', projectid='45aa68ef76ab4ec78cb3d85b6cf5dc57', projectname='tempest-ServerActionsTestOtherB-810999869'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637889.0296788) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:49.031934 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:49.032160 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:49.033354 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:49.033354 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:49.034216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:49.034471 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:49.034602 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:49.035004 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:49.035004 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:49.035116 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:49.035177 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:49.035353 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:49.035458 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:49.035564 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:49.035666 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:49.035812 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:49.035985 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:49.053806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:49.184782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:49.186803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:49.188277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:04:49.392857 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:49.393021 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:49.393211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:49.393382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:25:16:8e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:49.394025 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Using config drive
May 13 02:04:49.409859 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2b30b4-e347-42f6-9c2e-5ef35c934639 req-2ff57e2a-9571-49c1-b409-3074ea8d4138 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-deleted-073d3192-c5b8-4719-a274-cfb77eae1845 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:49.410953 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-eb2b30b4-e347-42f6-9c2e-5ef35c934639 req-2ff57e2a-9571-49c1-b409-3074ea8d4138 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Neutron deleted interface 073d3192-c5b8-4719-a274-cfb77eae1845; detaching it from the instance and deleting it from the info cache
May 13 02:04:49.411040 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb2b30b4-e347-42f6-9c2e-5ef35c934639 req-2ff57e2a-9571-49c1-b409-3074ea8d4138 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53755aee-e02b-4634-865f-27868f510ce5", "address": "fa:16:3e:2e:08:90", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53755aee-e0", "ovs_interfaceid": "53755aee-e02b-4634-865f-27868f510ce5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:49.423132 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:49.466106 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Detaching volume db16316f-1893-48fc-aa65-daa691756182
May 13 02:04:49.503912 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Attempting to driver detach volume db16316f-1893-48fc-aa65-daa691756182 from mountpoint /dev/vdb
May 13 02:04:49.507372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-db16316f-1893-48fc-aa65-daa691756182 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:49.508414 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-db16316f-1893-48fc-aa65-daa691756182 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:04:49.508529 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Attempting to detach device vdb from instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:04:49.508731 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <alias name="ua-db16316f-1893-48fc-aa65-daa691756182"/>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-5"/>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <serial>db16316f-1893-48fc-aa65-daa691756182</serial>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:49.508731 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:49.514709 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 from the persistent domain config.
May 13 02:04:49.514709 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] (1/8): Attempting to detach device vdb with device alias ua-db16316f-1893-48fc-aa65-daa691756182 from instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:04:49.514709 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <alias name="ua-db16316f-1893-48fc-aa65-daa691756182"/>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-5"/>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <serial>db16316f-1893-48fc-aa65-daa691756182</serial>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:49.514709 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:04:49.564279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:49.630162 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1b0dd85f-6961-4df9-ba66-01799de08e3c req-975604f1-9b45-4c4b-973a-b4d912e37dee service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-deleted-53755aee-e02b-4634-865f-27868f510ce5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:49.630897 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-1b0dd85f-6961-4df9-ba66-01799de08e3c req-975604f1-9b45-4c4b-973a-b4d912e37dee service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Neutron deleted interface 53755aee-e02b-4634-865f-27868f510ce5; detaching it from the instance and deleting it from the info cache
May 13 02:04:49.630897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1b0dd85f-6961-4df9-ba66-01799de08e3c req-975604f1-9b45-4c4b-973a-b4d912e37dee service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "address": "fa:16:3e:a3:d3:54", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b61a3a-75", "ovs_interfaceid": "f1b61a3a-75f3-4453-8ca1-c1ae9ca25023", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:49.676436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:49.677028 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:49.677372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:49.678107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:49.678599 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:49.679050 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:49.679251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:49.691255 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'flavor' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:49.867821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec82d57e-4e75-4005-a6dc-1ff543e387c9 req-2af00b01-a5a9-4489-92d8-23221555fb3e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-deleted-f1b61a3a-75f3-4453-8ca1-c1ae9ca25023 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:49.868211 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-ec82d57e-4e75-4005-a6dc-1ff543e387c9 req-2af00b01-a5a9-4489-92d8-23221555fb3e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Neutron deleted interface f1b61a3a-75f3-4453-8ca1-c1ae9ca25023; detaching it from the instance and deleting it from the info cache
May 13 02:04:49.868545 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ec82d57e-4e75-4005-a6dc-1ff543e387c9 req-2af00b01-a5a9-4489-92d8-23221555fb3e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [{"id": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "address": "fa:16:3e:aa:b3:2f", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf59acf5c-24", "ovs_interfaceid": "f59acf5c-2430-4923-a19c-85ad17c9c00d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "address": "fa:16:3e:cf:18:a4", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.87", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5c373b-bd", "ovs_interfaceid": "ff5c373b-bdb4-4bdd-86bf-2335ac2a28ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "efb9d48d-84ac-40ba-96c4-a6744a886582", "address": "fa:16:3e:a7:6e:1e", "network": {"id": "325d69d7-6c8f-4cf3-8b49-6d17fdaf736e", "bridge": "br-int", "label": "tempest-device-tagging-net1-19068949", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapefb9d48d-84", "ovs_interfaceid": "efb9d48d-84ac-40ba-96c4-a6744a886582", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "address": "fa:16:3e:03:c6:2c", "network": {"id": "0e9c0226-f73d-467a-9562-fa10ccc3784a", "bridge": "br-int", "label": "tempest-device-tagging-net2-23544256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f64cf62c02d24c7680e5ac91383a3afb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ad9866b-a0", "ovs_interfaceid": "5ad9866b-a0bf-47d3-b9d0-494bcace2c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:49.898588 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'ec2_ids' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:49.916625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2b30b4-e347-42f6-9c2e-5ef35c934639 req-2ff57e2a-9571-49c1-b409-3074ea8d4138 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Detach interface failed, port_id=073d3192-c5b8-4719-a274-cfb77eae1845, reason: Instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:04:49.935534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.732s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:49.936114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:04:49.938214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.973s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:49.943749 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:04:49.943749 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Claim successful on node np0000000663
May 13 02:04:50.070209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637890.0697036, b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 => ua-db16316f-1893-48fc-aa65-daa691756182> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:04:50.070907 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-db16316f-1893-48fc-aa65-daa691756182 for instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:04:50.076280 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 from the live domain config.
May 13 02:04:50.077342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:50.078768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:50.078768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:50.135200 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1b0dd85f-6961-4df9-ba66-01799de08e3c req-975604f1-9b45-4c4b-973a-b4d912e37dee service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Detach interface failed, port_id=53755aee-e02b-4634-865f-27868f510ce5, reason: Instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:04:50.141880 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:50.206625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Found WWN 33000000018c705e9 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:50.206625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:50.206625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] <== connect_volume: return (4504ms) {'type': 'block', 'scsi_wwn': '33000000018c705e9', 'path': '/dev/dm-0', 'multipath_id': '33000000018c705e9'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:50.206625 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018c705e9', 'path': '/dev/dm-0', 'multipath_id': '33000000018c705e9'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:50.207574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.528s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:50.207871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:50.210918 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lazy-loading 'flavor' on Instance uuid 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:50.224073 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:50.224566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:50.227815 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:50.228662 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:50.229288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:50.229486 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:50.242161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:50.242161 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:50.248556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:50.248556 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:50.253658 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:04:50.253658 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:50.253658 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:50.253658 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:50.253658 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:50.253658 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:50.253658 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:50.253853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:50.254001 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:50.254153 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:50.259644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5] added
May 13 02:04:50.259644 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:50.259644 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:50.259644 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:50.259644 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:50.259644 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:50.259644 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:50.259870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:50.260141 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:50.260141 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:50.374792 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec82d57e-4e75-4005-a6dc-1ff543e387c9 req-2af00b01-a5a9-4489-92d8-23221555fb3e service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Detach interface failed, port_id=f1b61a3a-75f3-4453-8ca1-c1ae9ca25023, reason: Instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:04:50.404059 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:50.404200 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'keypairs' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:50.441610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:04:50.442195 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:04:50.442517 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:50.442741 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:50.506986 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ebfe9f4cab0466b93295e0e3b02ab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417bbe722944360a9197829e22c0cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:04:50.696995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:50.714267 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Attempting to attach volume 0ba2f007-0687-4387-8c23-f398f471c374 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:04:50.716355 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:   <alias name="ua-0ba2f007-0687-4387-8c23-f398f471c374"/>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:   <serial>0ba2f007-0687-4387-8c23-f398f471c374</serial>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:50.716355 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:04:50.799063 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:50.885059 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:50.886031 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:04:50.908265 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:50.913760 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:50.946699 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:04:51.009771 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Successfully created port: ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:04:51.121628 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Creating config drive at /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config.rescue
May 13 02:04:51.124909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfc7_sp8t {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:51.166370 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfc7_sp8t" returned: 0 in 0.041s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:51.254809 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:51.262307 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:51.275178 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:51.275178 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:51.282762 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:51.282762 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.290124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.295692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.301915 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Took 3.63 seconds to deallocate network for instance.
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.305597 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.305846 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.316872 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.316997 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:51.367160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:04:51.367160 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:04:51.367160 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.379534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:04:51.379534 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:04:51.379534 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.390522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.396528 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:51.403486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.421884 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.422282 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:51.424116 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:51.424116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:51.424660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:51.424660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:51.426806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('9', '-', '-', 0) found on session 25 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:51.427114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] HCTL ('10', '-', '-', 0) found on session 26 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:51.427336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:51.429115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:51.448236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 25 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:51.448236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:51.452477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:51.452567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:51.453628 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:04:51.587854 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-102f1da4-4f43-4d5c-9719-9f28933f785e req-4614795f-0d4c-409e-9849-7a1c2230ee28 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-deleted-5ad9866b-a0bf-47d3-b9d0-494bcace2c6d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:51.607718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:51.607718 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:51.659006 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Successfully updated port: ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:04:51.662671 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.688836 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.693609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.712351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e8fcb50-6aa4-4c96-8528-55c1572c39bf req-0512db3d-7d7e-4a30-9916-9f47550f28b1 service nova] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Received event network-vif-deleted-efb9d48d-84ac-40ba-96c4-a6744a886582 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:51.777886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:51.777886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:51.777886 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attaching volume baffaa32-ddfa-4dbd-a321-1bf9540bae35 to /dev/vdb
May 13 02:04:51.783509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.805322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.805322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:51.823859 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:51.838258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:51.863539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:51.905592 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:51.907495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:51.915765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:51.917201 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fec0:b96c', 'fe80::246e:ebff:fe19:2929', 'fe80::fc16:3eff:fe25:168e'] 
May 13 02:04:51.917323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:51.917445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:51.917649 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:51.917861 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating existing volume attachment record: c602339a-1ff1-43a8-93ff-1873f83a650c {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:04:52.111935 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:52.167377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:52.167544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:52.167675 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:52.229005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:04:52.398874 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:52.399059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:52.399207 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:52.399365 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] No VIF found with MAC fa:16:3e:c0:b9:6c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:52.466916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:04:52.468175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:04:52.468363 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Creating image(s)
May 13 02:04:52.468838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:52.469012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:52.470713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:52.472808 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:52.475709 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:52.476885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:52.495366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:52.496030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:52.497687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:52.543114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for d8e796d1-f442-4a33-935b-863c6340bbca due to new event <LifecycleEvent: 1778637892.5426915, d8e796d1-f442-4a33-935b-863c6340bbca => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:04:52.543321 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637892.5426915, d8e796d1-f442-4a33-935b-863c6340bbca => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:52.547054 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Resumed (Lifecycle Event)
May 13 02:04:52.552241 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-88157aa9-83f3-41b6-8590-0d48256f01b2 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:52.560856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:52.561303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:52.561881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:52.565116 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:52.567313 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:04:52.571707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:52.623402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.687s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:52.625188 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:04:52.629833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.233s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:52.629990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:52.631736 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:04:52.660731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:52.662873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:52.712573 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk 1073741824" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:52.713129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:52.713476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:52.778148 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:52.807730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:52.811111 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:04:52.811111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:52.886433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:52.886838 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Cannot resize image /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:04:52.887308 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:04:52.887521 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Ensure instance console log exists: /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:52.887888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:52.888156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:52.888456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:53.003173 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Took 1.70 seconds to detach 3 volumes for instance.
May 13 02:04:53.029233 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:53.050294 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:53.054121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:53.134579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:04:53.134853 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:04:53.135207 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:53.135556 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:53.206372 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:53.229869 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58ed109293f84e5da5e931ff8db316ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f3e57d4283544449e40b60367c11476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:04:53.245402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Found WWN 330000000236426d5 for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:53.245845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:53.246109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== connect_volume: return (3566ms) {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-1', 'multipath_id': '330000000236426d5'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:53.246271 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000236426d5', 'path': '/dev/dm-1', 'multipath_id': '330000000236426d5'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:53.250437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.172s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:53.250437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db16316f-1893-48fc-aa65-daa691756182', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:53.250437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:53.277765 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182 (non-flash)
May 13 02:04:53.279371 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:53.279371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '10')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:53.281556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182', '9')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:53.282362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c268e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:53.283585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:53.283585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flush multipath device 330000000c292b99f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:53.319406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:53.385823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:53.433200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:53.433200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:53.433200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:53.447911 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:53.448521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:53.462656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.502207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.40.100,3260]
May 13 02:04:53.502207 np0000000663 nova-compute[98103]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.40.100,3260] successful.
May 13 02:04:53.502207 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.509059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:53.509282 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:53.522491 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.537134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.555008 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637893.5545273, d8e796d1-f442-4a33-935b-863c6340bbca => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:53.555106 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Started (Lifecycle Event)
May 13 02:04:53.571567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.50.100,3260]
May 13 02:04:53.571567 np0000000663 nova-compute[98103]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-db16316f-1893-48fc-aa65-daa691756182, portal: 192.168.50.100,3260] successful.
May 13 02:04:53.571567 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.595644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.596140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:53.596550 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== disconnect_volume: return (3518ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:53.597804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:53.598330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.102s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:53.598601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:53.613681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:53.618201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:53.618201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:53.618201 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:53.619608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:53.619814 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:53.633066 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:53.633066 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.639555 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:04:53.646640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35] added
May 13 02:04:53.646640 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:53.646640 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:53.646640 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:53.646640 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:53.646640 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:53.646640 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.649031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:53.649031 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.649031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:53.649031 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:53.649031 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:53.663385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35] added
May 13 02:04:53.663385 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:53.663385 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:53.663385 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:53.663385 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:53.663385 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:53.663385 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:53.663686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:53.663817 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.044(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:53.663997 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:53.678804 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:53.712507 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-changed-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:53.712954 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing instance network info cache due to event network-changed-ef65e23b-b93f-4302-b817-cde4b9f86590. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:53.713469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:53.715139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:53.716113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Instance network_info: |[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:04:53.719689 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Start _get_guest_xml network_info=[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:53.723301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:53.725444 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing network info cache for port ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:53.730175 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:53.730175 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-232440299', uuid='7a5cc9f0-2163-4891-a47e-5a5647066474'), owner=OwnerMeta(userid='4ebfe9f4cab0466b93295e0e3b02ab7b', username='tempest-TaggedAttachmentsTest-2007551033-project-member', projectid='3417bbe722944360a9197829e22c0cf0', projectname='tempest-TaggedAttachmentsTest-2007551033'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637893.7295918) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:53.731574 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:53.732178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:53.735276 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:53.735630 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:53.737080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:53.737718 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:53.738629 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:53.738836 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:53.739007 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:53.739601 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:53.739601 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:53.740371 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:53.740371 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:53.740371 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:53.740371 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:53.740691 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:53.768679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:34Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:53.770368 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:53.771350 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:53.774125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <uuid>2973c226-2c35-4da1-bd21-cddd0fcbbb34</uuid>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <name>instance-00000008</name>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherB-server-1897002082</nova:name>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:49</nova:creationTime>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:user uuid="7b7888f9faa44571ba756dfc65e033d5">tempest-ServerActionsTestOtherB-810999869-project-member</nova:user>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:project uuid="45aa68ef76ab4ec78cb3d85b6cf5dc57">tempest-ServerActionsTestOtherB-810999869</nova:project>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         <nova:port uuid="11134c0d-5266-455d-9b09-07953c0b92c2">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="serial">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="uuid">2973c226-2c35-4da1-bd21-cddd0fcbbb34</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/disk.config"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <alias name="ua-8976cef6-0dd2-4a42-822e-4ca6754debd5"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <serial>8976cef6-0dd2-4a42-822e-4ca6754debd5</serial>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:64:87:88"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <target dev="tap11134c0d-52"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34/console.log" append="off"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:53.774125 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:53.781159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:53.781772 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Preparing to wait for external event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:04:53.782216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:53.782458 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:53.782895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:53.784561 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:34Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:53.789212 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:53.792130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:53.807787 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:53.816413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:04:53.817804 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:53.819412 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:53.820910 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:53.825024 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:53.828813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.833814 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Successfully created port: 998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:04:53.836913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:53.837574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:53.839261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.839576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55c3579d-fde6-5298-86c1-521c71b511ee', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:53.840719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.841917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:53.843448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.845890 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.846261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11134c0d-52, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:53.846829 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11134c0d-52, col_values=(('qos', UUID('1fc3d937-3718-4f55-ae8e-74561a328c17')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:53.847029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11134c0d-52, col_values=(('external_ids', {'iface-id': '11134c0d-5266-455d-9b09-07953c0b92c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:87:88', 'vm-uuid': '2973c226-2c35-4da1-bd21-cddd0fcbbb34'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:53.849544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.851807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:53.858614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:53.860331 np0000000663 nova-compute[98103]: INFO os_vif [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:04:53.876223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:53.881472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:53.972586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:53.973226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b773128e-08b0-447b-a84a-060fbebe61c4 tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.982s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:53.977159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.061647 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:54.067832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:54.076802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.085867 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.144890 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:04:54.175397 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:54.195139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.195746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.228476 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:54.303554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.309001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.341965 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] End _get_guest_xml xml=<domain type="qemu">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <uuid>7a5cc9f0-2163-4891-a47e-5a5647066474</uuid>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <name>instance-0000000f</name>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:53</nova:creationTime>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <system>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="serial">7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="uuid">7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </system>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <os>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </os>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <features>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </features>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   <devices>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </disk>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7e:07:a8"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <target dev="tapef65e23b-b9"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </interface>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log" append="off"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </serial>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <video>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </video>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </rng>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:   </devices>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]: </domain>
May 13 02:04:54.341965 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:04:54.344394 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Preparing to wait for external event network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:04:54.344394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:54.344394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:54.344394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:54.346223 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:04:54.346223 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:54.346223 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:54.346490 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:04:54.348379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.348807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:54.349171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:04:54.350296 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.350695 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c83e6142-9a7b-5a29-a6c1-aa6ac7d8d57c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:54.351873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.352887 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:54.359671 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.362950 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.364665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef65e23b-b9, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:54.364665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef65e23b-b9, col_values=(('qos', UUID('a607ac54-8fc0-4c06-8df3-38b27f46b2ad')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:54.364665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef65e23b-b9, col_values=(('external_ids', {'iface-id': 'ef65e23b-b93f-4302-b817-cde4b9f86590', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:07:a8', 'vm-uuid': '7a5cc9f0-2163-4891-a47e-5a5647066474'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:54.368765 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:54.379171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.380867 np0000000663 nova-compute[98103]: INFO os_vif [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9')
May 13 02:04:54.403111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.403862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.415117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.442458 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:54.442986 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:54.453076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.454350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.509682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.513372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:04:54.513449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.536880 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Successfully updated port: 998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:04:54.568208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.604196 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-changed-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:54.605374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Refreshing instance network info cache due to event network-changed-998fd126-103d-4849-a998-cf1a294e7fed. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:04:54.605662 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] Acquiring lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:54.605808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] Acquired lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:54.605972 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Refreshing network info cache for port 998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:04:54.616535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.617069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.652153 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:54.657360 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Booting with volume 89609779-0fe1-4836-8b88-0fecdb74ad85 at /dev/vda
May 13 02:04:54.665351 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:54.679182 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:54.679182 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:54.686162 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:54.686162 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.700583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.709292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.716782 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.717146 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:54.732187 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:54.736348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca/disk.rescue --force-share --output=json" returned: 0 in 0.119s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.736853 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.737582 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:54.745769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.774378 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Unrescuing
May 13 02:04:54.775115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:54.775813 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:54.781117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:54.782842 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:54.789933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260]
May 13 02:04:54.789933 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260] successful.
May 13 02:04:54.789933 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.791610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:04:54.794194 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260]
May 13 02:04:54.794194 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260] successful.
May 13 02:04:54.794194 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.814917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.815393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.823607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.830576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:54.852913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.855125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.874127 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:54.876749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.883035 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.883817 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:54.884686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.270s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:54.884908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.886760 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:54.887063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:54.899160 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:54.908310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.288s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:54.912957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:54.916740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:04:54.917987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:04:54.920957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('11', '-', '-', 0) found on session 27 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:54.920957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:54.921974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('12', '-', '-', 0) found on session 28 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:54.922153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:54.936749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:04:54.938844 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7d:c5f9', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fec0:b96c', 'fe80::246e:ebff:fe19:2929', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe64:8788', 'fe80::3835:2fff:fe90:49f7'] 
May 13 02:04:54.940575 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:04:54.968662 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:04:54.968662 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:54.968662 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating existing volume attachment record: 7cf91062-c394-4cf3-8dc9-2cf43bbd2778 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:04:54.976238 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:54.984917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:54.985881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:54.996366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.004983 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.009s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.008345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 28 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:55.013582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.013582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 27 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:55.015316 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:55.018001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:55.018687 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:55.019713 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:04:55.021464 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Terminating instance
May 13 02:04:55.030994 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:55.032368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:55.053610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:04:55.082774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:55.082774 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12927MB free_disk=74.4931640625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:04:55.082774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.110122 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updated VIF entry in instance network info cache for port ef65e23b-b93f-4302-b817-cde4b9f86590. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:04:55.110571 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:55.112445 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:55.145122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.186465 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:55.196567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-86310755-92cb-4083-bbc9-5f1a30dae721 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.233s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.298114 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:55.357123 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:55.514270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.517289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.518734 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.518938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.519133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.519479 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.435s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.522987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.527282 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Terminating instance
May 13 02:04:55.531634 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:55.550307 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 2973c226-2c35-4da1-bd21-cddd0fcbbb34 due to new event <LifecycleEvent: 1778637895.5489337, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Started> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:04:55.550307 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637895.5489337, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:55.550307 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Started (Lifecycle Event)
May 13 02:04:55.573800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.578482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.599561 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.611568 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Deleted allocations for instance 66b654d9-cad8-4b68-8ce5-30b605e35e0b
May 13 02:04:55.618552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:55.618776 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:55.618910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.619075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.622395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.624976 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.626108 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:55.628734 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state rescued and task_state None.
May 13 02:04:55.628964 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:55.629311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.637347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:04:55.637604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.638238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.638238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:55.638238 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b387b77f-ac7f-4314-89ae-6694bc86e84c req-3c1a8a0b-662c-458c-a1cc-15148d04f455 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state rescued and task_state None.
May 13 02:04:55.653906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:55.658104 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:55.784978 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:55.785167 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.785329 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.785477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.785588 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Processing event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:55.789246 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:55.789631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:55.789769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:55.789915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:55.790080 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:55.790252 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-83319b9e-a36b-4a4e-bfbf-15f8b90a2a48 req-38df9c69-e967-45a3-abe6-26db9887721e service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received unexpected event network-vif-plugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with vm_state resized and task_state resize_reverting.
May 13 02:04:55.790719 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:55.812554 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance running successfully.
May 13 02:04:55.813007 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] finish_revert_migration finished successfully. {{(pid=98103) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 13 02:04:55.854194 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [{"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:55.858110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce28fcb5-02b8-4d96-92b9-910a8bc78b36 req-4ce626ed-c62a-4ed7-bc19-75ef896718bc service nova] Releasing lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:55.858110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquired lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:04:55.858249 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:04:55.890688 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Instance destroyed successfully.
May 13 02:04:55.892022 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lazy-loading 'resources' on Instance uuid 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:55.931147 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:55.931287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:55.931402 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No VIF found with MAC fa:16:3e:7e:07:a8, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:55.931883 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Using config drive
May 13 02:04:56.035261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:56.054277 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:56.056571 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00032620299998598057 future=<Future at 0x705c6c2b1c70 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.0006983529999615712 future=<Future at 0x705c6c62eb70 state=cancelled>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.0006299560000115889 future=<Future at 0x705c6c62eb70 state=cancelled>) was cancelled while queued, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.064793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.43173104399988915 future=<Future at 0x705c6c2bd790 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.065122 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.4316616549999708 future=<Future at 0x705c6c2bd790 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.068934 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.071483 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.092924 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.102021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.137315 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.137755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.356121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-d8e796d1-f442-4a33-935b-863c6340bbca" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:56.356620 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'flavor' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:56.365974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.383368 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Instance destroyed successfully.
May 13 02:04:56.384710 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'resources' on Instance uuid b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:56.398011 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1267321414',display_name='tempest-DeleteServersTestJSON-server-1267321414',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-deleteserverstestjson-server-1267321414',id=14,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74938bb5b50b4802872e24928d9b173a',ramdisk_id='',reservation_id='r-m1c2gcbe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-532119916',owner_user_name='tempest-DeleteServersTestJSON-532119916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:40Z,user_data=None,user_id='41217929cd464e84bb0eff3c24cf366b',uuid=7c63e8c4-433f-4d58-9464-9f3e4ea486f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:56.398341 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converting VIF {"id": "0506ec99-0250-456f-a8ca-14f0fecec31b", "address": "fa:16:3e:c0:b9:6c", "network": {"id": "0ed2f1b6-ecec-49f8-978f-f288c44e97e3", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1931193225-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "74938bb5b50b4802872e24928d9b173a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0506ec99-02", "ovs_interfaceid": "0506ec99-0250-456f-a8ca-14f0fecec31b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:56.400311 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:56.401739 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:56.404629 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.404867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0506ec99-02, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:56.406185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.408027 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:56.441750 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:56.441750 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.442378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.442633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70fa973d-0a94-4484-ab6f-4ee7d105ef93) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:56.443979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.444888 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:56.455642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.458410 np0000000663 nova-compute[98103]: INFO os_vif [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b9:6c,bridge_name='br-int',has_traffic_filtering=True,id=0506ec99-0250-456f-a8ca-14f0fecec31b,network=Network(0ed2f1b6-ecec-49f8-978f-f288c44e97e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0506ec99-02')
May 13 02:04:56.460195 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:04:56.460479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:56.460714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:56.464894 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:04:56.497067 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00048476500001015665 future=<Future at 0x705c6c2bd790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.498294 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Emitting event <LifecycleEvent: 1778637881.496498, e2a3610f-9e9b-41d1-a3ba-96ded5816117 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:56.498449 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.498596 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.6537243360000957 future=<Future at 0x705c6c69d910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.499205 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.6536333260000902 future=<Future at 0x705c6c69d910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:56.499205 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] VM Stopped (Lifecycle Event)
May 13 02:04:56.563892 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 13 02:04:56.564269 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637896.5640235, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:56.567084 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Paused (Lifecycle Event)
May 13 02:04:56.611882 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Creating config drive at /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config
May 13 02:04:56.616212 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzugjphpp {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:04:56.657070 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660255 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660255 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1a8c3497-e0fe-475c-ad89-fccdb35ab740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660255 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance f757f7c1-4179-4c49-b986-a95d500f90ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660255 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2973c226-2c35-4da1-bd21-cddd0fcbbb34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c371b5bb-e471-4770-a69e-9a46af239d0f tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Lock "66b654d9-cad8-4b68-8ce5-30b605e35e0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.725s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:56.660590 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance d8e796d1-f442-4a33-935b-863c6340bbca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660590 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660678 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 7a5cc9f0-2163-4891-a47e-5a5647066474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.660808 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 51c00d54-54b0-41fb-af8e-2cb664c6a463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:04:56.661447 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:04:56.661447 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:04:55 up 28 min,  2 users,  load average: 9.23, 4.86, 2.28\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_deleting': '2', 'num_os_type_None': '9', 'num_proj_4b9a7e74db544084a4907abd0f241e8b': '1', 'io_workload': '2', 'num_vm_resized': '1', 'num_task_resize_reverting': '1', 'num_proj_45aa68ef76ab4ec78cb3d85b6cf5dc57': '1', 'num_task_None': '3', 'num_proj_eeca98c5180647b2910bdd1f13ac4196': '2', 'num_proj_32377a41c4fc4e2781fdff3229fc3395': '2', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_proj_74938bb5b50b4802872e24928d9b173a': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_3417bbe722944360a9197829e22c0cf0': '1', 'num_task_block_device_mapping': '1', 'num_proj_0f3e57d4283544449e40b60367c11476': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:04:56.669719 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzugjphpp" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:04:56.671459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found WWN 3300000005660298d for multipath device dm-2 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:04:56.671946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.074s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:56.677328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.212s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:56.677328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== connect_volume: return (4178ms) {'type': 'block', 'scsi_wwn': '3300000005660298d', 'path': '/dev/dm-2', 'multipath_id': '3300000005660298d'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:56.677328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0ba2f007-0687-4387-8c23-f398f471c374', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:04:56.677328 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005660298d', 'path': '/dev/dm-2', 'multipath_id': '3300000005660298d'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:04:56.677629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:04:56.689900 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'flavor' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:56.698222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:56.702620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:56.703186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:56.704879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:56.706594 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] No waiting events found dispatching network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:56.706799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:56.706974 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:56.707189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Acquiring lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:56.707375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:56.712233 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:56.717911 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:56.718117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] No waiting events found dispatching network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:56.719476 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d5ff9bbe-1df3-4d5e-b063-bbf141447547 req-07007fc5-3f36-4377-ae1f-647ec328023d service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-unplugged-6865b153-a6fa-487c-8945-9b5ea38fc3d0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:56.720898 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:56.721214 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:56.721214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '28')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:04:56.721468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '23')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:56.723526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374', '24')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:04:56.724692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c70ba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:04:56.724926 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:04:56.725230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Flush multipath device 33000000018c705e9 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:04:56.736366 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.750390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.754614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:56.756267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.786684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.800616 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.803622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:04:56.855077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:04:56.855330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:04:56.856724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:04:56.875554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:04:56.875758 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:04:56.886250 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cc28e307-d713-40de-82f1-d8a91020ebe9 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance to original state: 'active'
May 13 02:04:56.894037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1114422483',display_name='tempest-AttachVolumeNegativeTest-server-1114422483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1114422483',id=1,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE5/jqy0eWYc8TEo2LIFpbU1YLfIk/osIaUir/PFKpG7OPDuM+Oo4JeaRtqljanA9KV6lsKzs2pX7ltH0Oa/AWvOVfV2LFxS430wxbpLFVX/H6P13/BJeAJWJ0se6xN0A==',key_name='tempest-keypair-6940213',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:02:52Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-0z7b0i85',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:02:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:04:56.894499 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "address": "fa:16:3e:7d:c5:f9", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6865b153-a6", "ovs_interfaceid": "6865b153-a6fa-487c-8945-9b5ea38fc3d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:04:56.895208 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:04:56.895566 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:04:56.896805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:56.900197 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.903334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6865b153-a6, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:56.905843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.907660 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:56.926044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.928702 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.939955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.40.100,3260]
May 13 02:04:56.939955 np0000000663 nova-compute[98103]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.40.100,3260] successful.
May 13 02:04:56.939955 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:56.946127 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating instance_info_cache with network_info: [{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:56.961030 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.964962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:56.975187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.975735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d15cdf9-b248-43e7-b355-69f74af6a77b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:04:56.976363 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:56.977111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:04:56.984635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.003505 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: e2a3610f-9e9b-41d1-a3ba-96ded5816117] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:57.009459 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.013171 np0000000663 nova-compute[98103]: INFO os_vif [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:c5:f9,bridge_name='br-int',has_traffic_filtering=True,id=6865b153-a6fa-487c-8945-9b5ea38fc3d0,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6865b153-a6')
May 13 02:04:57.013634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Deleting instance files /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3_del
May 13 02:04:57.014639 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Deletion of /opt/stack/data/nova/instances/b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3_del complete
May 13 02:04:57.023114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.50.100,3260]
May 13 02:04:57.023114 np0000000663 nova-compute[98103]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-0ba2f007-0687-4387-8c23-f398f471c374, portal: 192.168.50.100,3260] successful.
May 13 02:04:57.023114 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.042448 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.042715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:57.042917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] <== disconnect_volume: return (582ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:04:57.044688 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:04:57.044688 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Deleting instance files /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0_del
May 13 02:04:57.044688 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Deletion of /opt/stack/data/nova/instances/7c63e8c4-433f-4d58-9464-9f3e4ea486f0_del complete
May 13 02:04:57.069034 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:57.078825 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637897.0784714, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:57.079115 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Resumed (Lifecycle Event)
May 13 02:04:57.160261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:04:57.161351 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:04:57.161609 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating image(s)
May 13 02:04:57.161856 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:04:57.161991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Ensure instance console log exists: /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:04:57.164130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:57.164130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:57.164130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:57.177863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.190501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.196340 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attempting to attach volume baffaa32-ddfa-4dbd-a321-1bf9540bae35 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:04:57.205454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:   <alias name="ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35"/>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-2"/>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:   <serial>baffaa32-ddfa-4dbd-a321-1bf9540bae35</serial>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]: </disk>
May 13 02:04:57.205454 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:04:57.232083 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.238401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.262938 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:04:57.263244 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:04:57.272054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.292779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.448568 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Releasing lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:04:57.448951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance network_info: |[{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:04:57.449644 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start _get_guest_xml network_info=[{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51c00d54-54b0-41fb-af8e-2cb664c6a463', 'attached_at': '', 'detached_at': '', 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'serial': '89609779-0fe1-4836-8b88-0fecdb74ad85'}, 'attachment_id': '7cf91062-c394-4cf3-8dc9-2cf43bbd2778', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:04:57.453221 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:04:57.454978 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1249907315', uuid='51c00d54-54b0-41fb-af8e-2cb664c6a463'), owner=OwnerMeta(userid='58ed109293f84e5da5e931ff8db316ba', username='tempest-ServerActionsV293TestJSON-1336454500-project-member', projectid='0f3e57d4283544449e40b60367c11476', projectname='tempest-ServerActionsV293TestJSON-1336454500'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637897.4543052) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:04:57.456912 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:04:57.457322 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:04:57.460048 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:04:57.460950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:04:57.461768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:04:57.462063 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:04:57.462225 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:04:57.462345 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:04:57.462530 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:04:57.462686 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:04:57.462686 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:04:57.462836 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:04:57.462929 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:04:57.464682 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:04:57.464761 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:04:57.464885 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:04:57.477003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.482132 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:04:57.483529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:04:57.483529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:57.484594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:57.484594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:04:57.491142 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance destroyed successfully.
May 13 02:04:57.491142 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'numa_topology' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:57.496620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:57.497139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:04:57.497933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:57.500466 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:57.501358 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:04:57.501757 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:57.520402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:57.520402 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.520865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:04:57.520865 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.529636 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Took 1.49 seconds to destroy the instance on the hypervisor.
May 13 02:04:57.531377 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:57.531655 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:57.531839 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:57.531990 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:57.536713 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85] added
May 13 02:04:57.536713 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:57.536713 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:57.536713 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:57.536713 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:57.536713 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:57.536713 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.537377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:57.537377 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:57.537377 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85] added
May 13 02:04:57.539204 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:04:57.539204 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:04:57.539204 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.041(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:04:57.539531 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:04:57.553237 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Took 2.02 seconds to destroy the instance on the hypervisor.
May 13 02:04:57.553886 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:04:57.554137 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:04:57.554234 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:04:57.554472 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:57.583829 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:57.588558 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:57.595682 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.609117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.636947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:57.639753 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:57.665036 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:04:57.766936 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:04:57.992932 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<d8e796d1-f442-4a33-935b-863c6340bbca> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:04:58.037486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.037486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.037734 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.037913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.038107 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] No waiting events found dispatching network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:58.042893 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:58.043021 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.043241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Acquiring lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.043438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.043680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.043881 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] No waiting events found dispatching network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:58.044062 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-unplugged-0506ec99-0250-456f-a8ca-14f0fecec31b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:04:58.044207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.044421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.044617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.044772 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.044979 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:58.045159 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state rescued and task_state unrescuing.
May 13 02:04:58.045330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.045554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.045725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.045856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.045996 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:04:58.046179 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state rescued and task_state unrescuing.
May 13 02:04:58.046344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.046508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.046670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.046814 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.047506 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-75b7c093-a419-42a2-80ae-985816e61fe1 req-d0dcef08-a26e-439d-a1b8-4b4b3e2bd829 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Processing event network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:04:58.093572 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999703929999896 future=<Future at 0x705c6c6281a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.093860 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999803294000003 future=<Future at 0x705c6c12d910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.094162 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999855471000046 future=<Future at 0x705c88190e00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.153301 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0010132830000202375 future=<Future at 0x705c6c69d910 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.153401 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.153501 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.939720253999894 future=<Future at 0x705c6c6281a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.153574 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.939644612999928 future=<Future at 0x705c6c6281a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:04:58.157114 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Emitting event <LifecycleEvent: 1778637883.1521862, 66b654d9-cad8-4b68-8ce5-30b605e35e0b => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:58.157236 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] VM Stopped (Lifecycle Event)
May 13 02:04:58.276277 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:04:58.276277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.759s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.276628 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:04:58.289770 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-011b0fa8-9b5d-4311-966e-5384b7416eae req-650d17f7-e134-466b-95bd-23e9aaa99f94 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Received event network-vif-deleted-6865b153-a6fa-487c-8945-9b5ea38fc3d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.290320 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-011b0fa8-9b5d-4311-966e-5384b7416eae req-650d17f7-e134-466b-95bd-23e9aaa99f94 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Neutron deleted interface 6865b153-a6fa-487c-8945-9b5ea38fc3d0; detaching it from the instance and deleting it from the info cache
May 13 02:04:58.290320 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-011b0fa8-9b5d-4311-966e-5384b7416eae req-650d17f7-e134-466b-95bd-23e9aaa99f94 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:58.435328 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:58.478816 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637898.4777682, 7a5cc9f0-2163-4891-a47e-5a5647066474 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:58.478816 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] VM Started (Lifecycle Event)
May 13 02:04:58.480211 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:04:58.484869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:58.488343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:04:58.501037 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Instance spawned successfully.
May 13 02:04:58.504127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:04:58.514525 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:58.537774 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:04:58.543512 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:58.552834 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:58.552834 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:04:58.562549 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:04:58.562549 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.571001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.579206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.593640 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.594294 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.596756 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:58.629269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:58.637539 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:58.638888 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:58.644712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260]
May 13 02:04:58.644712 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260] successful.
May 13 02:04:58.644712 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.650170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260]
May 13 02:04:58.650170 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260] successful.
May 13 02:04:58.650170 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.656531 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.662202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:04:58.666358 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.678241 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.678574 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:58.678857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:58.679003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:58.680638 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 66b654d9-cad8-4b68-8ce5-30b605e35e0b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.681507 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:04:58.681841 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:04:58.682476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:04:58.683129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:04:58.685136 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] HCTL ('7', '-', '-', 0) found on session 29 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:58.686110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:58.686335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] HCTL ('8', '-', '-', 0) found on session 30 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:04:58.686468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:04:58.706941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching for a device in session 29 and hctl ['7', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:58.727119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching for a device in session 30 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:58.727119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:58.798802 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-011b0fa8-9b5d-4311-966e-5384b7416eae req-650d17f7-e134-466b-95bd-23e9aaa99f94 service nova] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Detach interface failed, port_id=6865b153-a6fa-487c-8945-9b5ea38fc3d0, reason: Instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:04:58.818706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c0dcd79d-50df-4ea0-9a5c-e1edeb06d50f req-91170f57-d1d6-42f8-960a-c69bd2c274ed service nova] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Received event network-vif-deleted-0506ec99-0250-456f-a8ca-14f0fecec31b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:04:58.928489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.928489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.928489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:58.928674 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:58.928674 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:04:58.931667 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Terminating instance
May 13 02:04:58.944113 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Took 1.39 seconds to deallocate network for instance.
May 13 02:04:58.984267 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:58.991831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:04:59.016452 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.016660 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.017132 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.017824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.017824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.019239 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:04:59.100159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.168515 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Took 1.64 seconds to deallocate network for instance.
May 13 02:04:59.174588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:59.175039 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:59.175258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:04:59.175578 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:1d:2a:66, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:04:59.436417 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:04:59.465816 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.471117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.490182 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.492344 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:04:59.492660 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637899.4924576, 7a5cc9f0-2163-4891-a47e-5a5647066474 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:04:59.492860 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] VM Paused (Lifecycle Event)
May 13 02:04:59.511923 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.524636 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Took 7.06 seconds to spawn the instance on the hypervisor.
May 13 02:04:59.524847 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:59.536916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.540992 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Took 0.60 seconds to detach 1 volumes for instance.
May 13 02:04:59.585964 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f3de6bf9-0c54-4c5a-999e-83d2a5808c99 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:04:59.675238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:04:59.679334 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:04:59.707723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching for a device in session 29 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:04:59.707875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:04:59.739764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.768655 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:04:59.773402 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Instance destroyed successfully.
May 13 02:04:59.775662 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lazy-loading 'resources' on Instance uuid 2973c226-2c35-4da1-bd21-cddd0fcbbb34 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:04:59.997945 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:00.000381 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637900.000154, 7a5cc9f0-2163-4891-a47e-5a5647066474 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:00.001396 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] VM Resumed (Lifecycle Event)
May 13 02:05:00.044107 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Took 12.91 seconds to build instance.
May 13 02:05:00.050035 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.052187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.057503 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.062373 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.083390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.094303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.115033 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received unexpected event network-vif-plugged-ef65e23b-b93f-4302-b817-cde4b9f86590 for instance with vm_state active and task_state None.
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:00.116204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.116963 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:00.117202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.117589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:00.117794 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state active and task_state None.
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received unexpected event network-vif-plugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with vm_state active and task_state None.
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Acquiring lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] No waiting events found dispatching network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:00.120269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d2e6105-156c-42df-98f3-359097cba391 req-cb246c16-c5e9-4f56-923e-089a89d77157 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-unplugged-11134c0d-5266-455d-9b09-07953c0b92c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:05:00.144239 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.186981 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.211317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.257165 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:00.257354 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:00.277901 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1897002082',display_name='tempest-ServerActionsTestOtherB-server-1897002082',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestotherb-server-1897002082',id=8,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILlJxWbe1il73Gi2Z97JrzCjYeLxfRhH40ce6tewgkqmurGdP0ebMfeZFUX3tQJNi7O+zbENlyP73+1JkX8PELKiZA5Vu1/0qUzeOqx28XznA3OBDRFx2mfwq1zBM70fQ==',key_name='tempest-keypair-1835298026',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:56Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45aa68ef76ab4ec78cb3d85b6cf5dc57',ramdisk_id='',reservation_id='r-pgpdyhon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-810999869',owner_user_name='tempest-ServerActionsTestOtherB-810999869-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b7888f9faa44571ba756dfc65e033d5',uuid=2973c226-2c35-4da1-bd21-cddd0fcbbb34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:05:00.278066 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converting VIF {"id": "11134c0d-5266-455d-9b09-07953c0b92c2", "address": "fa:16:3e:64:87:88", "network": {"id": "c63afecb-26d6-402f-9280-6ad01accbcbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-776637087-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "45aa68ef76ab4ec78cb3d85b6cf5dc57", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap11134c0d-52", "ovs_interfaceid": "11134c0d-5266-455d-9b09-07953c0b92c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:00.278616 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:00.278880 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:05:00.279836 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.280068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11134c0d-52, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:00.281135 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.281871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:00.282840 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.283780 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.283909 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fc3d937-3718-4f55-ae8e-74561a328c17) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:00.284398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:00.285087 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:00.286995 np0000000663 nova-compute[98103]: INFO os_vif [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:87:88,bridge_name='br-int',has_traffic_filtering=True,id=11134c0d-5266-455d-9b09-07953c0b92c2,network=Network(c63afecb-26d6-402f-9280-6ad01accbcbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11134c0d-52')
May 13 02:05:00.294892 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:05:00.295155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:00.295256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:00.503186 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:00.506416 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:00.517668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Found WWN 3300000002430ed53 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:05:00.517959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:00.518172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000002430ed53', 'path': '/dev/dm-0', 'multipath_id': '3300000002430ed53'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:00.518332 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002430ed53', 'path': '/dev/dm-0', 'multipath_id': '3300000002430ed53'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:05:00.518886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.223s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:00.519266 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8976cef6-0dd2-4a42-822e-4ca6754debd5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:05:00.519428 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:05:00.546677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.426s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:00.552498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:00.552786 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:00.552786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '30')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:05:00.553153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '26')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:00.554359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5', '25')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:00.555183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c699760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:05:00.555463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:05:00.555696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Flush multipath device 330000000236426d5 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:05:00.590357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:00.653237 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:00.692417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:05:00.692564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:05:00.693432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:05:00.707813 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:05:00.708167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:05:00.721499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.745790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90edab52-f770-465f-9e66-b715e53008a8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.969s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:00.758366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260]
May 13 02:05:00.758366 np0000000663 nova-compute[98103]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.40.100,3260] successful.
May 13 02:05:00.758366 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.759804 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:00.785552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.799466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.841626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260]
May 13 02:05:00.841626 np0000000663 nova-compute[98103]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-8976cef6-0dd2-4a42-822e-4ca6754debd5, portal: 192.168.50.100,3260] successful.
May 13 02:05:00.841626 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.857148 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:00.857447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:00.857614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] <== disconnect_volume: return (561ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:00.857782 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:05:00.858143 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Deleting instance files /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_del
May 13 02:05:00.864885 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Deletion of /opt/stack/data/nova/instances/2973c226-2c35-4da1-bd21-cddd0fcbbb34_del complete
May 13 02:05:01.010662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for d8e796d1-f442-4a33-935b-863c6340bbca due to new event <LifecycleEvent: 1778637901.0101342, d8e796d1-f442-4a33-935b-863c6340bbca => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:05:01.010662 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637901.0101342, d8e796d1-f442-4a33-935b-863c6340bbca => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:01.011175 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Resumed (Lifecycle Event)
May 13 02:05:01.030176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1249907315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:01.030560 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:01.031280 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:01.032851 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lazy-loading 'pci_devices' on Instance uuid 51c00d54-54b0-41fb-af8e-2cb664c6a463 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:01.267744 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.588s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:01.269608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.218s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:01.345152 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Deleted allocations for instance b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3
May 13 02:05:01.372551 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Took 1.94 seconds to destroy the instance on the hypervisor.
May 13 02:05:01.373533 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:05:01.374143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:05:01.374372 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:05:01.374882 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:01.467989 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:01.484901 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-changed-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:01.485272 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing instance network info cache due to event network-changed-ef65e23b-b93f-4302-b817-cde4b9f86590. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:01.485540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:01.485578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:01.485687 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing network info cache for port ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:01.513949 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:01.515982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:01.538208 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <uuid>51c00d54-54b0-41fb-af8e-2cb664c6a463</uuid>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <name>instance-00000010</name>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1249907315</nova:name>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:04:57</nova:creationTime>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:user uuid="58ed109293f84e5da5e931ff8db316ba">tempest-ServerActionsV293TestJSON-1336454500-project-member</nova:user>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:project uuid="0f3e57d4283544449e40b60367c11476">tempest-ServerActionsV293TestJSON-1336454500</nova:project>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         <nova:port uuid="998fd126-103d-4849-a998-cf1a294e7fed">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="serial">51c00d54-54b0-41fb-af8e-2cb664c6a463</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="uuid">51c00d54-54b0-41fb-af8e-2cb664c6a463</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <alias name="ua-89609779-0fe1-4836-8b88-0fecdb74ad85"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <serial>89609779-0fe1-4836-8b88-0fecdb74ad85</serial>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:78:d0:35"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <target dev="tap998fd126-10"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/console.log" append="off"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:01.538208 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:01.540289 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Preparing to wait for external event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:01.540289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:01.540289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:01.540289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:01.540828 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1249907315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:04:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:01.541382 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:01.543001 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:01.543416 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:01.543838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.544179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:01.544458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:01.545362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.545589 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76463694-c980-5634-9e43-121bccb6964b', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:01.547322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.547322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:01.548465 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.553271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.553609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap998fd126-10, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:01.554065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap998fd126-10, col_values=(('qos', UUID('b61239aa-a22a-449c-b86b-e64dba248231')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:01.554319 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap998fd126-10, col_values=(('external_ids', {'iface-id': '998fd126-103d-4849-a998-cf1a294e7fed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d0:35', 'vm-uuid': '51c00d54-54b0-41fb-af8e-2cb664c6a463'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:01.555391 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.558516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:01.562139 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:01.563506 np0000000663 nova-compute[98103]: INFO os_vif [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10')
May 13 02:05:01.795606 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:01.796061 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:01.990690 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:02.018211 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637902.0179074, d8e796d1-f442-4a33-935b-863c6340bbca => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:02.018634 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Started (Lifecycle Event)
May 13 02:05:02.183225 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dc01eb0e-4e58-4ae7-8899-dc0b63598684 req-688eaba4-a03e-40df-93ce-7be2a75ec162 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Received event network-vif-deleted-11134c0d-5266-455d-9b09-07953c0b92c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:02.183353 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-dc01eb0e-4e58-4ae7-8899-dc0b63598684 req-688eaba4-a03e-40df-93ce-7be2a75ec162 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Neutron deleted interface 11134c0d-5266-455d-9b09-07953c0b92c2; detaching it from the instance and deleting it from the info cache
May 13 02:05:02.183534 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dc01eb0e-4e58-4ae7-8899-dc0b63598684 req-688eaba4-a03e-40df-93ce-7be2a75ec162 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:02.298240 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:02.307624 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:02.353719 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3e2b5440-743d-4298-b5e6-ec921e1c319a tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.835s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:02.401003 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:02.401244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:02.426249 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:02.476540 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updated VIF entry in instance network info cache for port ef65e23b-b93f-4302-b817-cde4b9f86590. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:05:02.476907 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:02.521539 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:02.524711 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:02.686210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dc01eb0e-4e58-4ae7-8899-dc0b63598684 req-688eaba4-a03e-40df-93ce-7be2a75ec162 service nova] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Detach interface failed, port_id=11134c0d-5266-455d-9b09-07953c0b92c2, reason: Instance 2973c226-2c35-4da1-bd21-cddd0fcbbb34 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:05:02.805733 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.538s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:02.869906 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Deleted allocations for instance 7c63e8c4-433f-4d58-9464-9f3e4ea486f0
May 13 02:05:02.906542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:02.928159 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Took 1.55 seconds to deallocate network for instance.
May 13 02:05:02.978949 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2e00ad8-9a30-46d7-b4e4-acb10d06371a req-5c11f38c-f11b-4153-a239-0cc296adb448 service nova] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:03.026934 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99974710000015 future=<Future at 0x705c88193140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:03.076429 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Rebuilding instance
May 13 02:05:03.085798 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:03.085943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:03.086076 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No VIF found with MAC fa:16:3e:78:d0:35, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:03.086564 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Using config drive
May 13 02:05:03.302447 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:03.464029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:03.464295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:03.467663 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:03.467869 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Claim successful on node np0000000663
May 13 02:05:03.482509 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Took 0.55 seconds to detach 1 volumes for instance.
May 13 02:05:03.592671 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:03.731293 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating config drive at /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config
May 13 02:05:03.735045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9e7y9ukq {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:03.787332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9e7y9ukq" returned: 0 in 0.052s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:03.880808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1408108d-7dfe-4e5b-ac06-2c78bf294cdf tempest-DeleteServersTestJSON-532119916 tempest-DeleteServersTestJSON-532119916-project-member] Lock "7c63e8c4-433f-4d58-9464-9f3e4ea486f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.895s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:03.991907 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:04.220215 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.243519 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.273544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.277362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.338632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.341210 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.361887 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.394706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.538189 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Refreshing inventories for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 02:05:04.601777 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Updating ProviderTree inventory for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 02:05:04.601777 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:05:04.639328 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.649915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.655806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.664049 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Refreshing aggregate associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, aggregates: None {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 02:05:04.668190 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c82d87-eb58-4c16-9ff2-e87ed267378f req-32148a4a-48fc-4150-93cf-b25a30d1f2d4 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:04.668583 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c82d87-eb58-4c16-9ff2-e87ed267378f req-32148a4a-48fc-4150-93cf-b25a30d1f2d4 service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:04.669396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c82d87-eb58-4c16-9ff2-e87ed267378f req-32148a4a-48fc-4150-93cf-b25a30d1f2d4 service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:04.669396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c82d87-eb58-4c16-9ff2-e87ed267378f req-32148a4a-48fc-4150-93cf-b25a30d1f2d4 service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:04.669396 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c82d87-eb58-4c16-9ff2-e87ed267378f req-32148a4a-48fc-4150-93cf-b25a30d1f2d4 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Processing event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:04.680746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.689505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.691866 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999587383000062 future=<Future at 0x705c6c28ffe0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:04.700249 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance destroyed successfully.
May 13 02:05:04.747607 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Refreshing trait associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, traits: COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ARCH_AARCH64,HW_CPU_X86_MMX,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_MIPSEL,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 02:05:04.793046 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Detaching volume baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:05:04.849151 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attempting to driver detach volume baffaa32-ddfa-4dbd-a321-1bf9540bae35 from mountpoint /dev/vdb
May 13 02:05:04.855234 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found disk vdb by alias ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:05:04.855350 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Attempting to detach device vdb from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:05:04.855650 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <alias name="ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35"/>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-2"/>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <serial>baffaa32-ddfa-4dbd-a321-1bf9540bae35</serial>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]: </disk>
May 13 02:05:04.855650 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:05:04.866549 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully detached device vdb from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the persistent domain config.
May 13 02:05:04.867742 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:05:04.870110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:04.870110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:04.870110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:04.870110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:05:04.870110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:04.904171 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:04.904369 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:04.904564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '30')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:05:04.904715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '27')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:04.905767 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '28')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:04.906624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6a8b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:05:04.910120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:05:04.910120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flush multipath device 3300000005660298d {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:05:04.943568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:04.956463 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.962523 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:04.994549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:05.052871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:05:05.053076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:05:05.054040 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:05:05.065987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:05:05.066230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:05:05.078027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.109453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260]
May 13 02:05:05.109453 np0000000663 nova-compute[98103]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260] successful.
May 13 02:05:05.109453 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.128883 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.146489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:05.149855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.182438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260]
May 13 02:05:05.182438 np0000000663 nova-compute[98103]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260] successful.
May 13 02:05:05.182438 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.199978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:05.201068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:05.201283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== disconnect_volume: return (332ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:05.201534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:05:05.271634 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:05.271729 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:05.311276 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637905.3108346, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:05.312064 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:05.314139 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:05.315383 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Started (Lifecycle Event)
May 13 02:05:05.316248 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance spawned successfully.
May 13 02:05:05.316764 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:05.557920 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:05.558142 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:05.775278 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:05.818776 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:05.822926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:05.829475 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:05.829617 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:05.830728 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:05.831652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:05.831652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:05.831853 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:06.060110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:06.285436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.821s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:06.285840 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:06.288086 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.296s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:06.299289 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance destroyed successfully.
May 13 02:05:06.300206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-ServerActionsTestOtherA-server-1540344872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:10Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:05:06.300393 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:06.301132 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:06.301306 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:05:06.305044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:06.306285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e46685-d4, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:06.308838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:06.309539 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:06.311110 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:06.311339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5c9b65a-36ec-463f-b468-8c3306280218) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:06.312953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:06.313241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:06.316811 np0000000663 nova-compute[98103]: INFO os_vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4')
May 13 02:05:06.318194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:05:06.318382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:06.318547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:06.318876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:06.319204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:05:06.319488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:05:06.327820 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:06.328081 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637906.3279052, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:06.328226 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Paused (Lifecycle Event)
May 13 02:05:06.339225 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Took 9.18 seconds to spawn the instance on the hypervisor.
May 13 02:05:06.339493 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:06.352156 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:06.352156 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:06.352156 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:06.352156 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:06.352156 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:06.352327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:06.352327 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:06.352327 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:06.352327 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:06.352327 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:06.352420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '30')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:05:06.352537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:06.353131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:05:06.353240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:06.354723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:05:06.354806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7daa20>, {}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:05:06.354836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Disconnecting from: [] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:05:06.355482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.036s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:06.355635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== disconnect_volume: return (36ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:06.355733 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:05:06.355985 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Deleting instance files /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad_del
May 13 02:05:06.358336 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Deletion of /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad_del complete
May 13 02:05:06.616254 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:06.746646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:06.748373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:06.748537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:06.748653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:06.748821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:06.748962 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received unexpected event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with vm_state active and task_state None.
May 13 02:05:06.749059 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:06.749195 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:06.749388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:06.750193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:06.752361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:06.752599 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:06.752750 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received unexpected event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda for instance with vm_state active and task_state rebuilding.
May 13 02:05:06.752886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:06.753101 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:06.753296 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:06.753459 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:06.753592 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:06.753727 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db4b3ec6-da24-4530-aca4-7c1d6bb7d954 req-39d17256-75cd-4040-96d5-cf3fc065507e service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received unexpected event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda for instance with vm_state active and task_state rebuilding.
May 13 02:05:06.797293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:06.797813 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:06.797883 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:06.798222 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:06.832369 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:06.835195 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637906.83487, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:06.835422 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Resumed (Lifecycle Event)
May 13 02:05:06.858232 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Took 17.95 seconds to build instance.
May 13 02:05:06.909577 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7be413eb9340d1af627622a3e917fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32377a41c4fc4e2781fdff3229fc3395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:06.951698 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:06.951698 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:07.081627 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:07.300871 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:07.339568 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:07.345250 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:07.361178 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ad9ad66-c575-4326-b630-bfa20af60398 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.466s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:07.380182 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Booting with volume baffaa32-ddfa-4dbd-a321-1bf9540bae35 at /dev/vdb
May 13 02:05:07.453412 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:07.455310 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:07.468489 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:07.496125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:07.516871 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Successfully created port: ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:07.539967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:07.540840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:07.549528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:07.552111 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207'] 
May 13 02:05:07.552111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:07.552111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:07.552111 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:07.552422 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating existing volume attachment record: fc50171c-f285-4c5b-97bb-5b6424ffaad3 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:07.806006 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:07.968122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.680s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:07.970494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.354s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:07.974643 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:07.974808 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Claim successful on node np0000000663
May 13 02:05:08.039126 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Deleted allocations for instance 2973c226-2c35-4da1-bd21-cddd0fcbbb34
May 13 02:05:08.156698 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Successfully updated port: ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:08.203661 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-changed-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:08.203953 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Refreshing instance network info cache due to event network-changed-998fd126-103d-4849-a998-cf1a294e7fed. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:08.204226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] Acquiring lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:08.204442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] Acquired lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:08.204619 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Refreshing network info cache for port 998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:08.660699 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:08.660819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:08.660926 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:08.707541 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:08.801304 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-changed-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:08.801304 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Refreshing instance network info cache due to event network-changed-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:08.801418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] Acquiring lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:08.822573 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:08.826943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:08.827231 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Creating image(s)
May 13 02:05:08.827811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:08.828031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:08.829260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:08.829861 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:08.832955 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:08.834541 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:08.934392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:08.934702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:08.935099 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:08.935473 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:08.937777 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:08.938112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:09.024287 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:09.024746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:09.060495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dca0aaab-ea4e-446f-b7e2-86543a82a099 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Lock "2973c226-2c35-4da1-bd21-cddd0fcbbb34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.132s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:09.077140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk 1073741824" returned: 0 in 0.052s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:09.077482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:09.077780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:09.172265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:09.172265 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:09.172265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:09.254748 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:09.274237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:09.274632 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Cannot resize image /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:09.274931 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:09.275146 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Ensure instance console log exists: /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:09.275456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:09.275684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:09.275817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:09.310832 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:09.486153 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updated VIF entry in instance network info cache for port 998fd126-103d-4849-a998-cf1a294e7fed. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:05:09.486561 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating instance_info_cache with network_info: [{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:09.556544 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:09.719725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:09.719980 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating image(s)
May 13 02:05:09.720521 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:09.720692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:09.721220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:09.721488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:09.721824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:09.755673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:09.756106 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:09.769505 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Updating instance_info_cache with network_info: [{"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:09.990333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34df2527-40f2-458b-b43d-2a789a26881a req-10f0a31a-e1af-4005-b6c0-d960fbf62bcf service nova] Releasing lock "refresh_cache-51c00d54-54b0-41fb-af8e-2cb664c6a463" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:10.147869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.260133 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:10.271886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:10.273011 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Instance network_info: |[{"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:10.274388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] Acquired lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:10.274388 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Refreshing network info cache for port ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:10.277842 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Start _get_guest_xml network_info=[{"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:10.282299 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:10.285664 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-19115054', uuid='e53ce1bc-0ccb-45b9-a44a-0b1313f84af7'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637910.2845848) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:10.289799 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:10.295542 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:10.300958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:10.301699 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:10.302823 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:10.303301 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:10.303624 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:10.307210 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:10.307786 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:10.307953 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:10.308128 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:10.308354 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:10.308590 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:10.308876 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:10.309021 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:10.309213 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:10.321481 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-19115054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-19115054',id=17,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-yjou0vem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:08Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=e53ce1bc-0ccb-45b9-a44a-0b1313f84af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:10.321673 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:10.322520 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:10.323112 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:10.390513 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.393083 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.393376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:10.495325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:10.495599 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] d1473902-f7a7-4b60-ab45-c49394eec657 was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:05:10.496689 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:05:10.496958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.part /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:10.695586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.part /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.converted" returned: 0 in 0.197s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:10.702385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:10.772354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.800s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:10.773184 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:10.781385 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:10.803312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15.converted --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:10.803312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.081s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:10.804638 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.807703 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.808936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:10.832057 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <uuid>e53ce1bc-0ccb-45b9-a44a-0b1313f84af7</uuid>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <name>instance-00000011</name>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-19115054</nova:name>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:10</nova:creationTime>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         <nova:port uuid="ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="serial">e53ce1bc-0ccb-45b9-a44a-0b1313f84af7</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="uuid">e53ce1bc-0ccb-45b9-a44a-0b1313f84af7</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.config"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:9c:39:11"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <target dev="tapee18a68a-0d"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/console.log" append="off"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:10.832057 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Preparing to wait for external event network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-19115054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-19115054',id=17,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-yjou0vem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:08Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=e53ce1bc-0ccb-45b9-a44a-0b1313f84af7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:10.836938 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:10.839057 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.839686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:10.840075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:10.842310 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.843728 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd671980a-d01b-5d1c-a856-77935f66e2ca', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:10.846836 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:10.856384 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.856621 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee18a68a-0d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:10.857020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapee18a68a-0d, col_values=(('qos', UUID('04177165-879e-49ff-828b-102b9ecd41e0')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:10.857241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapee18a68a-0d, col_values=(('external_ids', {'iface-id': 'ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:39:11', 'vm-uuid': 'e53ce1bc-0ccb-45b9-a44a-0b1313f84af7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:10.858216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.859629 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:10.866837 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:10.868626 np0000000663 nova-compute[98103]: INFO os_vif [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d')
May 13 02:05:10.904029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:10.904536 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:10.904971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:10.905495 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.908161 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:10.908534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:11.000931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:11.001439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15,backing_fmt=raw /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:11.057514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15,backing_fmt=raw /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk 1073741824" returned: 0 in 0.056s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:11.057994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "4905db3ffc747a6742ab1c27859a185f6e1adb15" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:11.058413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:11.147809 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4905db3ffc747a6742ab1c27859a185f6e1adb15 --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:11.148383 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:11.148762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:11.240502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:11.241424 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Cannot resize image /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:11.241857 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:11.242217 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Ensure instance console log exists: /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:11.242538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:11.242814 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:11.242967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:11.246202 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start _get_guest_xml network_info=[{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T02:00:05Z,direct_url=<?>,disk_format='qcow2',id=d1473902-f7a7-4b60-ab45-c49394eec657,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T02:00:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f757f7c1-4179-4c49-b986-a95d500f90ad', 'attached_at': '', 'detached_at': '', 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'serial': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35'}, 'attachment_id': 'fc50171c-f285-4c5b-97bb-5b6424ffaad3', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:11.250262 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 13 02:05:11.252068 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='d1473902-f7a7-4b60-ab45-c49394eec657', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1540344872', uuid='f757f7c1-4179-4c49-b986-a95d500f90ad'), owner=OwnerMeta(userid='33425a40c04d488bba6393ace2394be5', username='tempest-ServerActionsTestOtherA-1936571963-project-member', projectid='eeca98c5180647b2910bdd1f13ac4196', projectname='tempest-ServerActionsTestOtherA-1936571963'), image=ImageMeta(id='d1473902-f7a7-4b60-ab45-c49394eec657', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637911.2516193) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:11.253371 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:11.253829 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:11.255255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:11.255480 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:11.256702 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:11.257123 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T02:00:05Z,direct_url=<?>,disk_format='qcow2',id=d1473902-f7a7-4b60-ab45-c49394eec657,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T02:00:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:11.257323 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:11.257456 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:11.257603 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:11.257701 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:11.257814 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:11.257998 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:11.258163 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:11.258324 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:11.258474 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:11.258616 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:11.258798 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'vcpu_model' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:11.281972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:11.282497 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:11.284225 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:11.284225 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:11.505660 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:11.714082 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff4dd8b153c4ae98a37ba022bb538c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9a7e74db544084a4907abd0f241e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:11.717147 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:11.771235 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:05:11.771449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:11.772108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:11.772108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:11.772108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:05:11.786339 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:11.787122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:11.787543 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:11.789048 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:11.791914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:11.794000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:11.794000 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:11.802032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:11.802032 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:11.811964 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:11.811964 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:11.820681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35] added
May 13 02:05:11.820681 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:11.820681 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:11.820681 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:11.820681 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:11.820681 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:11.820681 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:11.820935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:11.821189 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:11.821189 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:11.825805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35] added
May 13 02:05:11.825805 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:11.825805 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:11.825805 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:11.825805 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:11.825805 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:11.825805 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:11.826265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:11.826322 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:11.826539 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:12.299875 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:12.397312 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:12.397614 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:12.397872 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:9c:39:11, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:12.400336 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Using config drive
May 13 02:05:12.609520 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:12.821695 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:12.827821 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:12.838020 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:12.838020 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:12.847284 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:12.847284 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.858218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.866889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.872585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.872585 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.872585 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.872585 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.872585 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:12.872869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.872869 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.872869 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.872869 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.872869 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.891797 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:12.907447 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:12.912736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260]
May 13 02:05:12.912736 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260] successful.
May 13 02:05:12.912736 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.929682 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.940247 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260]
May 13 02:05:12.940247 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260] successful.
May 13 02:05:12.940247 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.946384 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.946763 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:12.946958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:12.947064 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:12.950115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('9', '-', '-', 0) found on session 31 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:12.950115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:12.961367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:12.972053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 31 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:12.972053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.983012 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:12.983376 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:12.985036 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:12.985937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:12.986519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('10', '-', '-', 0) found on session 32 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:12.986688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:13.012258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 32 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:13.012258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:13.093887 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005681070001628541 future=<Future at 0x705c6c6281a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.096518 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.096744 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0029943590000129916 future=<Future at 0x705c6c12d910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.100831 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.003168843000139532 future=<Future at 0x705c6c12d910 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.102013 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Emitting event <LifecycleEvent: 1778637898.093171, 7c63e8c4-433f-4d58-9464-9f3e4ea486f0 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:13.102274 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] VM Stopped (Lifecycle Event)
May 13 02:05:13.103853 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.104975 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.010632590999875902 future=<Future at 0x705c88190e00 state=cancelled>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.104975 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.010747032999915973 future=<Future at 0x705c88190e00 state=cancelled>) was cancelled while queued, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.104975 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.104975 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.921728984000083 future=<Future at 0x705c88193140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.104975 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.921662709999964 future=<Future at 0x705c88193140 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:13.105471 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Emitting event <LifecycleEvent: 1778637898.0936134, b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:13.105754 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] VM Stopped (Lifecycle Event)
May 13 02:05:13.283873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:13.313822 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:13.314852 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:13.315031 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Creating image(s)
May 13 02:05:13.315621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:13.317379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:13.317847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:13.318900 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:13.322256 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:13.326476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:13.433810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:13.434471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:13.435141 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:13.435895 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:13.440607 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:13.440917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:13.555856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:13.556498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:13.606494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 7c63e8c4-433f-4d58-9464-9f3e4ea486f0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:13.612159 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-59b00455-d357-4fdc-9f9a-5d126d61042b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: b490e123-d30d-4fe1-9dbc-fd6e34ee8bf3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:13.619977 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Successfully created port: 49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:13.623817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk 1073741824" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:13.624359 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:13.624955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:13.722917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:13.723423 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:13.723705 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:13.795113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:05:13.830411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:13.830721 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Cannot resize image /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:13.831231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:13.831351 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Ensure instance console log exists: /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:13.831677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:13.831952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:13.832121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:14.814251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found WWN 3300000005660298d for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:05:14.814251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:14.814251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000005660298d', 'path': '/dev/dm-1', 'multipath_id': '3300000005660298d'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:14.814251 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005660298d', 'path': '/dev/dm-1', 'multipath_id': '3300000005660298d'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:05:14.994125 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.072580 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.119785 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Updated VIF entry in instance network info cache for port ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:05:15.120143 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Updating instance_info_cache with network_info: [{"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:15.142073 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Creating config drive at /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.config
May 13 02:05:15.149681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphivpnfku {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:15.166710 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.216414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphivpnfku" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:15.323909 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-ServerActionsTestOtherA-server-1540344872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:10Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:15.324759 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:15.325003 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:15.331344 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <uuid>f757f7c1-4179-4c49-b986-a95d500f90ad</uuid>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <name>instance-0000000c</name>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherA-server-1540344872</nova:name>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:11</nova:creationTime>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:image uuid="d1473902-f7a7-4b60-ab45-c49394eec657">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:user uuid="33425a40c04d488bba6393ace2394be5">tempest-ServerActionsTestOtherA-1936571963-project-member</nova:user>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:project uuid="eeca98c5180647b2910bdd1f13ac4196">tempest-ServerActionsTestOtherA-1936571963</nova:project>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="d1473902-f7a7-4b60-ab45-c49394eec657"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         <nova:port uuid="77e46685-d447-44ae-a646-bea635926fda">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="serial">f757f7c1-4179-4c49-b986-a95d500f90ad</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="uuid">f757f7c1-4179-4c49-b986-a95d500f90ad</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <alias name="ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <serial>baffaa32-ddfa-4dbd-a321-1bf9540bae35</serial>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:1d:2a:66"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <target dev="tap77e46685-d4"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/console.log" append="off"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:15.331344 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-ServerActionsTestOtherA-server-1540344872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:10Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '749fd00c-587c-5948-995d-e05cccb43487', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.339877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:15.345749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.350656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.350656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e46685-d4, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:15.350656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77e46685-d4, col_values=(('qos', UUID('075224f6-c01d-4dd8-ac63-a9ce4f7987b4')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:15.350656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77e46685-d4, col_values=(('external_ids', {'iface-id': '77e46685-d447-44ae-a646-bea635926fda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:2a:66', 'vm-uuid': 'f757f7c1-4179-4c49-b986-a95d500f90ad'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:15.351527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.355967 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:15.363960 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.370142 np0000000663 nova-compute[98103]: INFO os_vif [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4')
May 13 02:05:15.624329 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae254a9c-ed61-4111-906e-993a9c600c03 req-44617ca1-af8a-4795-b284-d6b12f00e46a service nova] Releasing lock "refresh_cache-e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:15.647133 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Successfully updated port: 49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:15.733210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-changed-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:15.733584 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Refreshing instance network info cache due to event network-changed-49e85908-ceca-44ba-aa78-0f48bfd93126. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:15.733584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] Acquiring lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:15.737850 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] Acquired lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:15.737850 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Refreshing network info cache for port 49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:15.803349 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.844128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.948638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.962274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:15.968721 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:16.148802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:16.241555 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:16.346294 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:16.613733 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:16.858286 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637916.8578532, e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:16.859964 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] VM Started (Lifecycle Event)
May 13 02:05:16.912290 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:16.912588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:16.912657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:16.912812 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:1d:2a:66, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:16.913396 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Using config drive
May 13 02:05:17.117460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c712704-f200-43de-829a-3ddc87ae7f83 req-ffb9da20-052a-4240-8644-fa7c580e1077 service nova] Releasing lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:17.117460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquired lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:17.117460 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:17.364967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:17.370077 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637917.3697107, e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:17.370322 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] VM Paused (Lifecycle Event)
May 13 02:05:17.421500 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'ec2_ids' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:17.509563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:17.509758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:17.717222 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:17.873322 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:17.876967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:17.927380 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:17.929950 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Object Instance<f757f7c1-4179-4c49-b986-a95d500f90ad> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:05:17.930378 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'keypairs' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:18.014027 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:18.027967 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0010477690000243456 future=<Future at 0x705c88193140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:18.028368 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Emitting event <LifecycleEvent: 1778637903.0265841, 2973c226-2c35-4da1-bd21-cddd0fcbbb34 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:18.028834 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:18.029109 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] VM Stopped (Lifecycle Event)
May 13 02:05:18.030481 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.6609514609999678 future=<Future at 0x705c6c28ffe0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:18.030627 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.660789419999901 future=<Future at 0x705c6c28ffe0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:18.122123 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updating instance_info_cache with network_info: [{"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:18.380635 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:18.433856 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Object Instance<f757f7c1-4179-4c49-b986-a95d500f90ad> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:05:18.437665 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 13 02:05:18.533865 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 2973c226-2c35-4da1-bd21-cddd0fcbbb34] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:18.582135 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:18.582382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:18.586768 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Creating config drive at /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config
May 13 02:05:18.588716 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:18.588993 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Claim successful on node np0000000663
May 13 02:05:18.602119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyhs50eyg {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:18.628572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Releasing lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:18.629496 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance network_info: |[{"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:18.635171 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Start _get_guest_xml network_info=[{"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:18.635171 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:18.636431 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1717430461', uuid='73e6d52d-6b8e-4ddc-926a-19f2df275829'), owner=OwnerMeta(userid='0ff4dd8b153c4ae98a37ba022bb538c6', username='tempest-AttachVolumeNegativeTest-603660763-project-member', projectid='4b9a7e74db544084a4907abd0f241e8b', projectname='tempest-AttachVolumeNegativeTest-603660763'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637918.6360252) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:18.638743 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:18.639110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:18.640200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:18.640394 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:18.641459 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:18.641813 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:18.641953 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:18.642066 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:18.642208 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:18.642282 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:18.642435 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:18.642621 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:18.643034 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:18.643176 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:18.643283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:18.643432 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:18.651338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyhs50eyg" returned: 0 in 0.051s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:18.655247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1717430461',display_name='tempest-AttachVolumeNegativeTest-server-1717430461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1717430461',id=18,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn2GA2Om/OV7HC24qBHbaBBtfJsvkziONYkVqM4iryc0MIlYQlVfw2N20fk3gZZN+kwkINodevjG9/PjkHqrK7jkJBvDweAaornm+bR3Wrl8HQ+H0uh3Rk4EaVtJAK7AQ==',key_name='tempest-keypair-2140312991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-oerrrty3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=73e6d52d-6b8e-4ddc-926a-19f2df275829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:18.655491 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:18.656036 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:18.656821 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'pci_devices' on Instance uuid 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:19.069718 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.137250 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.159615 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <uuid>73e6d52d-6b8e-4ddc-926a-19f2df275829</uuid>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <name>instance-00000012</name>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1717430461</nova:name>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:18</nova:creationTime>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:user uuid="0ff4dd8b153c4ae98a37ba022bb538c6">tempest-AttachVolumeNegativeTest-603660763-project-member</nova:user>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:project uuid="4b9a7e74db544084a4907abd0f241e8b">tempest-AttachVolumeNegativeTest-603660763</nova:project>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         <nova:port uuid="49e85908-ceca-44ba-aa78-0f48bfd93126">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="serial">73e6d52d-6b8e-4ddc-926a-19f2df275829</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="uuid">73e6d52d-6b8e-4ddc-926a-19f2df275829</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.config"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:93:58:8b"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <target dev="tap49e85908-ce"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/console.log" append="off"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:19.159615 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Preparing to wait for external event network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1717430461',display_name='tempest-AttachVolumeNegativeTest-server-1717430461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1717430461',id=18,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn2GA2Om/OV7HC24qBHbaBBtfJsvkziONYkVqM4iryc0MIlYQlVfw2N20fk3gZZN+kwkINodevjG9/PjkHqrK7jkJBvDweAaornm+bR3Wrl8HQ+H0uh3Rk4EaVtJAK7AQ==',key_name='tempest-keypair-2140312991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-oerrrty3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=73e6d52d-6b8e-4ddc-926a-19f2df275829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.163848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:19.165029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:19.165029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.168286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a1ec3a0-2d6d-5672-8494-15d807ddb6d5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:19.171356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:19.174449 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.174800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49e85908-ce, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:19.175447 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49e85908-ce, col_values=(('qos', UUID('0d32bffa-653c-4c41-ae11-2cbfc1406e03')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:19.176788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49e85908-ce, col_values=(('external_ids', {'iface-id': '49e85908-ceca-44ba-aa78-0f48bfd93126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:58:8b', 'vm-uuid': '73e6d52d-6b8e-4ddc-926a-19f2df275829'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:19.179520 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.180214 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:19.203158 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.203528 np0000000663 nova-compute[98103]: INFO os_vif [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce')
May 13 02:05:19.267423 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.319433 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.325193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:19.568081 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:19.568748 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:19.569198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:19.569198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:19.569300 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:19.569464 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-52b5bc1c-6464-478d-b163-f53a315e44ff req-6bd5a624-8a2c-4f03-a168-907fae7a8cb3 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received unexpected event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda for instance with vm_state active and task_state rebuild_spawning.
May 13 02:05:19.691876 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004310680001253786 future=<Future at 0x705c6c28ffe0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:19.691973 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:19.692474 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] Emitting event <LifecycleEvent: 1778637904.6913307, f757f7c1-4179-4c49-b986-a95d500f90ad => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:19.692676 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Stopped (Lifecycle Event)
May 13 02:05:19.725691 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:20.125218 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:20.125609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:20.128123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for f757f7c1-4179-4c49-b986-a95d500f90ad due to new event <LifecycleEvent: 1778637920.1276326, f757f7c1-4179-4c49-b986-a95d500f90ad => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:05:20.128240 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637920.1276326, f757f7c1-4179-4c49-b986-a95d500f90ad => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:20.128454 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Resumed (Lifecycle Event)
May 13 02:05:20.133811 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance spawned successfully.
May 13 02:05:20.134418 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:20.154187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:20.195114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3510ebce-0661-447f-a8c9-891ef7766c03 tempest-TaggedBootDevicesTest-1829891618 tempest-TaggedBootDevicesTest-1829891618-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:20.212106 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:20.212333 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:20.631273 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:20.634331 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.649105 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:20.717178 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:20.728830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:20.728830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:20.728830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:93:58:8b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:20.728830 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Using config drive
May 13 02:05:21.141282 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 13 02:05:21.143735 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637921.1413693, f757f7c1-4179-4c49-b986-a95d500f90ad => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:21.143900 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Started (Lifecycle Event)
May 13 02:05:21.158528 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:21.195707 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:21.223754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.641s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:21.224303 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:21.240001 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:21.387754 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Creating config drive at /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.config
May 13 02:05:21.391715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx1wmjlvq {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:21.450184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx1wmjlvq" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:21.650470 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:21.655459 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:21.671919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:21.671919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:21.673181 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98103) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 13 02:05:21.748885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:21.749976 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:21.750824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:21.751402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:21.751590 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:21.756456 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:21.756582 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-972a4a9c-7d5b-4eae-abb1-b4bac87ebced req-0822cdb2-0656-42f6-8e3a-4866d7fa21e1 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received unexpected event network-vif-plugged-77e46685-d447-44ae-a646-bea635926fda for instance with vm_state active and task_state None.
May 13 02:05:21.757449 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:21.760772 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:21.760772 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:22.009517 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72370af71c554e2ca47f00350b367fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd404b9d2b7a545719b6529d1d75593f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:22.026782 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.056405 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.159951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f89b9167-1289-4ed9-9330-59c5a0dd9962 req-bd35d2d5-519d-4733-9b3d-fb53b35e00fb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:22.160376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f89b9167-1289-4ed9-9330-59c5a0dd9962 req-bd35d2d5-519d-4733-9b3d-fb53b35e00fb service nova] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:22.160376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f89b9167-1289-4ed9-9330-59c5a0dd9962 req-bd35d2d5-519d-4733-9b3d-fb53b35e00fb service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:22.160376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f89b9167-1289-4ed9-9330-59c5a0dd9962 req-bd35d2d5-519d-4733-9b3d-fb53b35e00fb service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:22.160539 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f89b9167-1289-4ed9-9330-59c5a0dd9962 req-bd35d2d5-519d-4733-9b3d-fb53b35e00fb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Processing event network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:22.161328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:22.169768 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637922.1694016, e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:22.171109 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] VM Resumed (Lifecycle Event)
May 13 02:05:22.188438 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.192363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:22.207961 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Instance spawned successfully.
May 13 02:05:22.208323 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:22.255761 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:22.437007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.438456 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.441927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.470179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:22.679555 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:22.683156 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:22.699237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f6c0ccfc-6fef-43af-a6f9-59902921c6c8 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.027s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:22.717982 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.721118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.721118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.721118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.721118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.721118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:22.760789 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:23.186250 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:23.208334 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637923.207911, 73e6d52d-6b8e-4ddc-926a-19f2df275829 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:23.208928 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] VM Started (Lifecycle Event)
May 13 02:05:23.230845 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Took 14.41 seconds to spawn the instance on the hypervisor.
May 13 02:05:23.231389 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:23.270340 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Successfully created port: ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:23.630982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:23.712330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:23.714797 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637923.7137356, 73e6d52d-6b8e-4ddc-926a-19f2df275829 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:23.714797 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] VM Paused (Lifecycle Event)
May 13 02:05:23.744388 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Took 20.33 seconds to build instance.
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Creating image(s)
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:23.780174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:23.780662 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:23.786086 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:23.789418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:23.830417 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:23.831102 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:23.831225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:23.831272 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:23.831529 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Processing event network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:23.831587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:23.832177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:23.832338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:23.832486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:23.832583 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:23.832724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] No waiting events found dispatching network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:23.832834 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-380fc180-6e37-4102-b542-08a00e97af53 req-87d6da16-4916-4d61-a07b-8bce7a59e263 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received unexpected event network-vif-plugged-49e85908-ceca-44ba-aa78-0f48bfd93126 for instance with vm_state building and task_state spawning.
May 13 02:05:23.837112 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:23.842114 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance spawned successfully.
May 13 02:05:23.842114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:23.876284 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Successfully updated port: ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:23.900165 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.111s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:23.900515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:23.901104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:23.901521 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:23.905646 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:23.908120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:23.957005 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-changed-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:23.957563 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Refreshing instance network info cache due to event network-changed-ad69885c-5302-4944-a8f3-444ac7ffe95a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:23.957780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] Acquiring lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:23.957831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] Acquired lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:23.958038 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Refreshing network info cache for port ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:24.022338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:24.025572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:24.078959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk 1073741824" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:24.079823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:24.080433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:24.178697 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:24.180834 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:24.180834 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:24.180982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:24.217914 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:24.229224 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637924.228176, 73e6d52d-6b8e-4ddc-926a-19f2df275829 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:24.229224 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] VM Resumed (Lifecycle Event)
May 13 02:05:24.249750 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5d9b5525-9891-4601-826e-a9f9c6b386a0 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.848s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:24.297341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:24.297728 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Cannot resize image /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:24.298082 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:24.298312 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Ensure instance console log exists: /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:24.298575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:24.298774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:24.298877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:24.351663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.352114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.352472 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.352742 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.352939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.353206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:24.383030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:24.400225 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:24.400225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:24.400412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:24.400412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:24.400636 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] No waiting events found dispatching network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:24.400829 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ff2a6b5e-04a3-45ee-aa9d-2624f5625517 req-7310aeda-ee08-47c2-8fa2-230394b57b53 service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received unexpected event network-vif-plugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 for instance with vm_state active and task_state None.
May 13 02:05:24.464992 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:24.572952 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:24.733426 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:24.738151 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:24.808432 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:24.861035 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Took 11.55 seconds to spawn the instance on the hypervisor.
May 13 02:05:24.863548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:25.156638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:25.244168 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:25.310562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb888903-aae3-4f09-840a-20e3bc945f1d req-379af835-90b5-4d80-9696-6d62fb91cdbb service nova] Releasing lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:25.310761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquired lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:25.310886 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:25.379816 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Took 18.81 seconds to build instance.
May 13 02:05:25.874523 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:25.880341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.322s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:26.060436 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:26.133482 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:26.422150 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Updating instance_info_cache with network_info: [{"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:26.579193 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] instance snapshotting
May 13 02:05:26.690334 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-changed-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:26.693530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Refreshing instance network info cache due to event network-changed-49e85908-ceca-44ba-aa78-0f48bfd93126. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:26.693667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] Acquiring lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:26.693734 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] Acquired lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:26.694617 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Refreshing network info cache for port 49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:26.720836 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Beginning live snapshot process
May 13 02:05:26.924800 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Releasing lock "refresh_cache-df1e125d-18cb-4cef-bfc7-9612eb69b3e1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:26.925258 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance network_info: |[{"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:26.927107 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Start _get_guest_xml network_info=[{"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:26.930031 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:26.931223 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-362211948', uuid='df1e125d-18cb-4cef-bfc7-9612eb69b3e1'), owner=OwnerMeta(userid='72370af71c554e2ca47f00350b367fd7', username='tempest-ServersNegativeTestJSON-577826386-project-member', projectid='d404b9d2b7a545719b6529d1d75593f1', projectname='tempest-ServersNegativeTestJSON-577826386'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637926.9308314) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:26.932325 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:26.932663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:26.933473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:26.933641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:26.934788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:26.935224 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:26.935392 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:26.935518 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:26.935649 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:26.935733 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:26.935858 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:26.936007 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:26.936194 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:26.936295 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:26.936473 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:26.936548 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:26.948627 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-362211948',display_name='tempest-ServersNegativeTestJSON-server-362211948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-362211948',id=19,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-90v6pvvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:23Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=df1e125d-18cb-4cef-bfc7-9612eb69b3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:26.948627 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:26.948627 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:26.949042 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lazy-loading 'pci_devices' on Instance uuid df1e125d-18cb-4cef-bfc7-9612eb69b3e1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:27.196259 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:27.342787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:27.342993 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:27.453266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <uuid>df1e125d-18cb-4cef-bfc7-9612eb69b3e1</uuid>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <name>instance-00000013</name>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServersNegativeTestJSON-server-362211948</nova:name>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:26</nova:creationTime>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:user uuid="72370af71c554e2ca47f00350b367fd7">tempest-ServersNegativeTestJSON-577826386-project-member</nova:user>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:project uuid="d404b9d2b7a545719b6529d1d75593f1">tempest-ServersNegativeTestJSON-577826386</nova:project>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         <nova:port uuid="ad69885c-5302-4944-a8f3-444ac7ffe95a">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="serial">df1e125d-18cb-4cef-bfc7-9612eb69b3e1</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="uuid">df1e125d-18cb-4cef-bfc7-9612eb69b3e1</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.config"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:ff:d3:18"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <target dev="tapad69885c-53"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/console.log" append="off"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:27.453266 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Preparing to wait for external event network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-362211948',display_name='tempest-ServersNegativeTestJSON-server-362211948',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-362211948',id=19,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-90v6pvvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:23Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=df1e125d-18cb-4cef-bfc7-9612eb69b3e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:27.456898 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:27.457351 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:27.457567 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:27.458576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:27.458983 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd7c7a81-3b70-5e87-be95-d8a535b5ab6f', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:27.460577 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:27.461255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:27.466397 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:27.466643 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad69885c-53, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:27.467066 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad69885c-53, col_values=(('qos', UUID('54a37e5b-9faf-4102-834a-cd38cb9cec90')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:27.467398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad69885c-53, col_values=(('external_ids', {'iface-id': 'ad69885c-5302-4944-a8f3-444ac7ffe95a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:d3:18', 'vm-uuid': 'df1e125d-18cb-4cef-bfc7-9612eb69b3e1'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:27.473321 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:27.475542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:27.477013 np0000000663 nova-compute[98103]: INFO os_vif [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53')
May 13 02:05:27.542893 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:27.680693 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updated VIF entry in instance network info cache for port 49e85908-ceca-44ba-aa78-0f48bfd93126. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:05:27.681010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updating instance_info_cache with network_info: [{"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:27.845274 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:28.183230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8c1d8201-2abf-4f97-9768-16044b1d388f req-e656b162-78ad-4137-ab97-08808ff5ba02 service nova] Releasing lock "refresh_cache-73e6d52d-6b8e-4ddc-926a-19f2df275829" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:28.236221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:28.312259 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json -f qcow2" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:28.312755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:28.394049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json -f qcow2" returned: 0 in 0.081s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:28.395805 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:28.404435 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:28.405484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:28.445162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:28.445420 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:28.450328 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:28.450523 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Claim successful on node np0000000663
May 13 02:05:28.501802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:28.502339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8.delta 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:28.552987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8.delta 1073741824" returned: 0 in 0.050s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:28.553525 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 02:05:28.852456 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:05:28.854677 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 02:05:28.902220 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:05:28.902528 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8.delta /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:29.006184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:29.006332 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:29.006446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No VIF found with MAC fa:16:3e:ff:d3:18, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:29.007380 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Using config drive
May 13 02:05:29.024640 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8.delta /opt/stack/data/nova/instances/snapshots/tmpj_d1mhco/7a89e07808b04de2906b482c11cf0ff8" returned: 0 in 0.122s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:29.025367 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Snapshot extracted, beginning image upload
May 13 02:05:29.514266 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:29.739210 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Creating config drive at /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.config
May 13 02:05:29.744086 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpme3vqxwt {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:29.801184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpme3vqxwt" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:30.156501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:30.193559 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:30.193559 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:30.295696 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:30.319115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:30.432303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:30.670401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:30.696018 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:30.696264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:30.696978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:30.696978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:30.696978 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] No event matching network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a in dict_keys([('network-vif-plugged', 'ad69885c-5302-4944-a8f3-444ac7ffe95a')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:05:30.696978 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-968fad79-67d2-4084-b55a-3b07a6b9d25a req-97c91d05-c3ac-4878-848e-b802085d4669 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received unexpected event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a for instance with vm_state building and task_state spawning.
May 13 02:05:30.700962 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:30.707216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:31.222244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.776s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:31.222653 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:31.341306 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637931.3408701, df1e125d-18cb-4cef-bfc7-9612eb69b3e1 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:31.341565 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] VM Started (Lifecycle Event)
May 13 02:05:31.732002 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:31.733398 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:31.733740 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:31.734043 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:31.844188 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:31.845401 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:31.848920 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637931.8486428, df1e125d-18cb-4cef-bfc7-9612eb69b3e1 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:31.849078 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] VM Paused (Lifecycle Event)
May 13 02:05:31.850298 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Snapshot image upload complete
May 13 02:05:31.850533 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4645e467-ba40-4ad8-97e5-812b9c04eb42 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Took 5.27 seconds to snapshot the instance on the hypervisor.
May 13 02:05:32.237276 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:32.291106 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Successfully created port: 479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:32.357696 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:32.359260 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:32.468301 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:32.742417 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:32.861463 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:32.868258 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Successfully updated port: 479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:33.170761 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-changed-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:33.170933 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Refreshing instance network info cache due to event network-changed-479ffd65-f819-4082-90f2-c1ef692a37b5. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:33.171165 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] Acquiring lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:33.171392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] Acquired lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:33.171663 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Refreshing network info cache for port 479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:33.245950 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Booting with volume 01a2d499-a178-412c-9a0e-e14d16a76d29 at /dev/vda
May 13 02:05:33.303066 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:33.316932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:33.343497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:33.375638 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:33.391600 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:33.394571 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:33.403787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:33.408701 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481'] 
May 13 02:05:33.408851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:33.408957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:33.409306 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:33.409567 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Updating existing volume attachment record: 57eb9c47-caac-475c-88d8-275d7d976e00 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:33.679051 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:33.766184 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:33.937112 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:34.097559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:34.097775 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:34.440086 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a26af55-3f1c-473c-9f9f-420f70eaf602 req-6e008f4a-88af-4ea6-a164-0e595d4ff0d7 service nova] Releasing lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:34.440631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:34.440897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:34.482525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:34.482713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:34.600042 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:34.985424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:35.026345 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:35.159224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:35.175537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:35.175537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:35.180762 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:35.181336 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Claim successful on node np0000000663
May 13 02:05:35.236309 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:35.374266 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Updating instance_info_cache with network_info: [{"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:35.555603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:35.556911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:35.558334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:35.558669 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Creating image(s)
May 13 02:05:35.559040 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:05:35.559961 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Ensure instance console log exists: /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:35.561846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:35.561846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:35.561846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:35.876633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-cbbe0827-c00e-48cf-92c5-9246a81c635c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:35.876950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance network_info: |[{"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:35.877986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Start _get_guest_xml network_info=[{"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cbbe0827-c00e-48cf-92c5-9246a81c635c', 'attached_at': '', 'detached_at': '', 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'serial': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'multiattach': True}, 'attachment_id': '57eb9c47-caac-475c-88d8-275d7d976e00', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:35.882994 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:35.884810 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-2012050803', uuid='cbbe0827-c00e-48cf-92c5-9246a81c635c'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637935.8842885) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:35.886306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:35.886827 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:35.888645 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:35.888928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:35.890234 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:35.890841 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:35.891062 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:35.891267 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:35.891535 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:35.891762 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:35.891958 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:35.892248 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:35.892457 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:35.893139 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:35.893139 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:35.893139 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:35.904171 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:05:35.904544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:35.904738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:35.905202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:35.905738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:05:35.917804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:35.918460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:35.918833 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:35.919040 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:35.919431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:35.919610 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:35.932856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:35.932856 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:35.940519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:35.940519 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:35.951314 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29] added
May 13 02:05:35.951314 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:35.951314 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:35.951314 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:35.951314 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:35.951314 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:35.951314 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:35.951633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:35.951851 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:35.952018 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:35.959282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29] added
May 13 02:05:35.959282 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:35.959282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:35.959282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:35.959282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:35.959282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:35.959282 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:35.959651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:35.959651 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:35.959788 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:36.318984 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3f028e7-6dc8-4c83-8be7-c160f315ba15 req-f5f66a96-b32a-475a-b930-f53fddac414e service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:36.321314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3f028e7-6dc8-4c83-8be7-c160f315ba15 req-f5f66a96-b32a-475a-b930-f53fddac414e service nova] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:36.321314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3f028e7-6dc8-4c83-8be7-c160f315ba15 req-f5f66a96-b32a-475a-b930-f53fddac414e service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:36.321314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3f028e7-6dc8-4c83-8be7-c160f315ba15 req-f5f66a96-b32a-475a-b930-f53fddac414e service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:36.321314 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3f028e7-6dc8-4c83-8be7-c160f315ba15 req-f5f66a96-b32a-475a-b930-f53fddac414e service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Processing event network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:36.321314 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:36.330167 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637936.3275986, df1e125d-18cb-4cef-bfc7-9612eb69b3e1 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:36.330167 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] VM Resumed (Lifecycle Event)
May 13 02:05:36.335398 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:36.338941 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance spawned successfully.
May 13 02:05:36.339412 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:36.836328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:36.841184 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:36.849168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.849168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.849168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.849168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.849463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.850442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:36.874216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:36.874687 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:36.952530 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:36.960213 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:36.967536 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:36.967536 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:36.977790 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:36.977790 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:36.979743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:36.991135 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.002385 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.002651 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.007032 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.007233 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:37.043749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.40.100,3260]
May 13 02:05:37.043749 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.40.100,3260] successful.
May 13 02:05:37.043749 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:37.049297 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.50.100,3260]
May 13 02:05:37.049297 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.50.100,3260] successful.
May 13 02:05:37.049297 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:37.057858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:37.064534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.073716 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.073967 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:37.074307 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:37.074475 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:37.075798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('11', '-', '-', 0) found on session 33 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:37.075952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.081654 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:37.082543 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:37.082543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:37.083628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('12', '-', '-', 0) found on session 34 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:37.083896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:37.096826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 33 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:37.097061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:37.103940 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 34 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:37.103940 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:37.347020 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:37.354739 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Took 13.58 seconds to spawn the instance on the hypervisor.
May 13 02:05:37.354856 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:37.380509 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:37.469396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:37.863219 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Took 19.35 seconds to build instance.
May 13 02:05:37.887747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.713s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:37.888500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.333s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:37.888822 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:37.893975 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:37.894150 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Claim successful on node np0000000663
May 13 02:05:37.919771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:05:38.365172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6820a3d8-6fc4-415c-ba01-5cb6aa4a9b29 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.855s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] No waiting events found dispatching network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:38.384866 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-9dc6dc59-f27a-46a6-9937-5e13782bbe36 req-95f44a37-8a90-4e8a-881c-e204dba245d3 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received unexpected event network-vif-plugged-ad69885c-5302-4944-a8f3-444ac7ffe95a for instance with vm_state active and task_state None.
May 13 02:05:38.400279 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:38.400532 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:38.400835 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:38.401061 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:38.492046 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab7be413eb9340d1af627622a3e917fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32377a41c4fc4e2781fdff3229fc3395', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:38.641122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:38.641122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:38.641122 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:38.911663 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:38.949337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 3300000003944c611 for multipath device dm-2 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:05:38.949626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:38.949744 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000003944c611', 'path': '/dev/dm-2', 'multipath_id': '3300000003944c611'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:38.950212 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003944c611', 'path': '/dev/dm-2', 'multipath_id': '3300000003944c611'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:05:39.011490 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Successfully created port: 301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:39.143252 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:39.328318 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'pci_requests' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:39.419240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:39.462177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2012050803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-2012050803',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2cdkoxr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:33Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=cbbe0827-c00e-48cf-92c5-9246a81c635c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:39.462484 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:39.463224 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:39.463974 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid cbbe0827-c00e-48cf-92c5-9246a81c635c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:39.547976 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:39.548225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:39.604183 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Successfully updated port: 301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:39.675012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-changed-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:39.675466 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Refreshing instance network info cache due to event network-changed-301f181e-9efe-400b-afda-57ad52597154. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:39.675677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] Acquiring lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:39.675810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] Acquired lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:39.676062 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Refreshing network info cache for port 301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:39.723600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:39.723845 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:39.830959 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Object Instance<7a5cc9f0-2163-4891-a47e-5a5647066474> lazy-loaded attributes: flavor,pci_requests {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:05:39.831237 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:39.831525 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:39.831810 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:39.927750 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Booting with volume-backed-image ce64da57-4ea7-4983-8f5e-9324f00e60fa at /dev/vda
May 13 02:05:39.935818 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ebfe9f4cab0466b93295e0e3b02ab7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3417bbe722944360a9197829e22c0cf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:39.972217 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <uuid>cbbe0827-c00e-48cf-92c5-9246a81c635c</uuid>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <name>instance-00000014</name>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-2012050803</nova:name>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:35</nova:creationTime>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         <nova:port uuid="479ffd65-f819-4082-90f2-c1ef692a37b5">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="serial">cbbe0827-c00e-48cf-92c5-9246a81c635c</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="uuid">cbbe0827-c00e-48cf-92c5-9246a81c635c</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/disk.config"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <alias name="ua-01a2d499-a178-412c-9a0e-e14d16a76d29"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-2"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <serial>01a2d499-a178-412c-9a0e-e14d16a76d29</serial>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <shareable/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:39:ba:89"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <target dev="tap479ffd65-f8"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/console.log" append="off"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:39.972217 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Preparing to wait for external event network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2012050803',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-2012050803',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2cdkoxr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:33Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=cbbe0827-c00e-48cf-92c5-9246a81c635c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:39.974886 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:39.975768 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:39.975768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.975768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:39.976058 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:39.977445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.977638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dc299e0-9972-5388-9371-0fa4ca3316aa', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:39.978588 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.979614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:39.980335 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.984998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.984998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap479ffd65-f8, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:39.985408 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap479ffd65-f8, col_values=(('qos', UUID('6f05c713-268a-40e7-aa1a-2b4251ee98dd')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:39.985632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap479ffd65-f8, col_values=(('external_ids', {'iface-id': '479ffd65-f819-4082-90f2-c1ef692a37b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:ba:89', 'vm-uuid': 'cbbe0827-c00e-48cf-92c5-9246a81c635c'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:39.986955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.988612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:39.994544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:39.995846 np0000000663 nova-compute[98103]: INFO os_vif [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8')
May 13 02:05:40.055380 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:40.108791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:40.162029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:40.180908 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:40.228113 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:40.259234 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:40.446560 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:40.515131 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Successfully created port: 4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:40.651483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:40.742869 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.855s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:40.743494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:40.747182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.096s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:40.754785 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:40.754945 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Claim successful on node np0000000663
May 13 02:05:40.950743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56cecf78-b863-4a41-a11b-4d8d673e110b req-07241d26-11b4-412b-9510-fab031451b74 service nova] Releasing lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:40.951313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:40.952458 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:41.158085 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Successfully updated port: 4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:41.252138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:41.252405 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:41.252664 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:41.252898 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:41.348965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-changed-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:41.348965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing instance network info cache due to event network-changed-4c04d792-7bf7-4791-9065-b0f3552370de. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:41.348965 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:41.349067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:41.349122 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Refreshing network info cache for port 4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:41.526295 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:41.529699 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:41.529699 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:41.529901 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:39:ba:89, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:41.530395 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Using config drive
May 13 02:05:41.579157 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8201863596dd42ae8139fd90ed3eccdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2064c6bb5ec4e528d35b2ba7473eada', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:41.661990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:41.754500 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:41.757427 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:41.852340 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:42.013532 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating instance_info_cache with network_info: [{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:42.037531 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:42.292576 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Creating config drive at /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/disk.config
May 13 02:05:42.300067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5j32_0_5 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:42.336897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully created port: 427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:42.362652 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5j32_0_5" returned: 0 in 0.063s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:42.372627 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:42.518835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:42.522673 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance network_info: |[{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:42.617566 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Added VIF to instance network info cache for port 4c04d792-7bf7-4791-9065-b0f3552370de. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3528}}
May 13 02:05:42.618055 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:42.755913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:42.755913 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:42.890582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:42.911893 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully created port: 940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:42.927047 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.037362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.115420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-514822aa-1d9d-4277-b601-d18203ef9b66 req-71f14cd2-f0f0-4658-a26d-d48b913be1e3 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:43.115846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-514822aa-1d9d-4277-b601-d18203ef9b66 req-71f14cd2-f0f0-4658-a26d-d48b913be1e3 service nova] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:43.115982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-514822aa-1d9d-4277-b601-d18203ef9b66 req-71f14cd2-f0f0-4658-a26d-d48b913be1e3 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:43.116180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-514822aa-1d9d-4277-b601-d18203ef9b66 req-71f14cd2-f0f0-4658-a26d-d48b913be1e3 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:43.116365 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-514822aa-1d9d-4277-b601-d18203ef9b66 req-71f14cd2-f0f0-4658-a26d-d48b913be1e3 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Processing event network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:43.122852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-462c4f41-4516-483f-b5a1-d7e9c44efbd6 req-a431c0dd-0d33-4738-bfea-f7302e1e8a00 service nova] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:43.124699 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:43.125070 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:43.259257 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:43.280453 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:43.292198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.295451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.303172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.336653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:43.499820 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully created port: f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:43.586201 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:43.598145 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:43.622626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:43.658005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:43.658456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:43.674250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:43.674741 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450'] 
May 13 02:05:43.674741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:43.674893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:43.675117 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:43.675720 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating existing volume attachment record: 890a68ad-65b9-429f-af66-65a4b3a3cd4b {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:43.713164 np0000000663 nova-compute[98103]: WARNING nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] 0278991a-cdad-4146-873e-db103180eda5 already exists in list: networks containing: ['0278991a-cdad-4146-873e-db103180eda5']. ignoring it
May 13 02:05:43.713401 np0000000663 nova-compute[98103]: WARNING nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] 4c04d792-7bf7-4791-9065-b0f3552370de already exists in list: port_ids containing: ['4c04d792-7bf7-4791-9065-b0f3552370de']. ignoring it
May 13 02:05:43.775780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.027s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:43.775780 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:43.792316 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Booting with volume c6553a22-915e-4fc6-9086-13a095be0c86 at /dev/vda
May 13 02:05:43.870674 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:43.883510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:43.910170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:43.952847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:43.953375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:43.966914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:43.968051 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450'] 
May 13 02:05:43.968284 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:43.968511 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:43.968963 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:43.969510 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating existing volume attachment record: 4fcb9035-84cc-4ff1-bcf9-a9f2d8075669 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:44.003161 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637944.002247, cbbe0827-c00e-48cf-92c5-9246a81c635c => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:44.003161 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] VM Started (Lifecycle Event)
May 13 02:05:44.008831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:44.013727 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:44.016750 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance spawned successfully.
May 13 02:05:44.017488 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:44.023785 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:44.129242 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully created port: 0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:44.285550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:44.286111 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:44.286600 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:44.287274 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:44.419832 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72370af71c554e2ca47f00350b367fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd404b9d2b7a545719b6529d1d75593f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:44.459044 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:44.509423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:44.512071 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:44.540243 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.540243 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.540591 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.540822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.543768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.543768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:44.697669 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:44.709579 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully created port: 41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:44.788444 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:44.991471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.017151 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:45.017482 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637945.017251, cbbe0827-c00e-48cf-92c5-9246a81c635c => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:45.017625 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] VM Paused (Lifecycle Event)
May 13 02:05:45.049585 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Took 9.49 seconds to spawn the instance on the hypervisor.
May 13 02:05:45.049585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:45.164767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.175223 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Successfully created port: 68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:45.199938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:45.202478 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:45.202872 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:45.203380 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:45.203644 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:45.205198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.205198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:45.205198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:45.205937 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.206150 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7265e756-1678-5eec-b584-5ce6336aa7b5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:45.209822 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.210736 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:45.211307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.215149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.215149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c04d792-7b, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:45.215274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c04d792-7b, col_values=(('qos', UUID('2679ce61-315e-4393-839e-5d6dda6c3f1c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:45.215438 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c04d792-7b, col_values=(('external_ids', {'iface-id': '4c04d792-7bf7-4791-9065-b0f3552370de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:31:48', 'vm-uuid': '7a5cc9f0-2163-4891-a47e-5a5647066474'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:45.217581 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.219283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:45.225978 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.227322 np0000000663 nova-compute[98103]: INFO os_vif [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b')
May 13 02:05:45.228443 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:45.229032 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:45.230159 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:45.232381 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] attach device xml: <interface type="ethernet">
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:   <mac address="fa:16:3e:6d:31:48"/>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:   <model type="virtio"/>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:   <driver name="qemu"/>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:   <mtu size="1372"/>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:   <target dev="tap4c04d792-7b"/>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]: </interface>
May 13 02:05:45.232381 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:05:45.246661 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.297499 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:45.350287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.350842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.385439 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:45.385714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:45.386257 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:45.386406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:45.386715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] No waiting events found dispatching network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:45.386869 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-fd8c9888-ca96-4718-bd7e-4e234fe1f63c req-d1d8e875-02fa-4df7-9b76-6b934b041dbb service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received unexpected event network-vif-plugged-479ffd65-f819-4082-90f2-c1ef692a37b5 for instance with vm_state active and task_state None.
May 13 02:05:45.399404 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.430805 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:45.522497 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:45.527076 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637945.5257974, cbbe0827-c00e-48cf-92c5-9246a81c635c => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:45.527076 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] VM Resumed (Lifecycle Event)
May 13 02:05:45.561959 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Took 17.21 seconds to build instance.
May 13 02:05:45.636325 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Booting with volume c3bfb2e9-1ce3-463a-8a86-5332d8158e3f at /dev/vdb
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-427e00b4-93dd-4fa7-9124-1214b806e8d0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:45.719835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.723160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.733981 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.739167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:45.759255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:45.776454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:45.827054 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:45.828917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:45.829257 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Creating image(s)
May 13 02:05:45.829628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:05:45.829818 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Ensure instance console log exists: /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:45.830141 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:45.830417 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:45.830787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:45.831932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:45.832247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start _get_guest_xml network_info=[{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '07452882-6f7c-42c9-a561-800356006fcc', 'attached_at': '', 'detached_at': '', 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'serial': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b'}, 'attachment_id': '890a68ad-65b9-429f-af66-65a4b3a3cd4b', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:45.832928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:45.837467 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:45.839177 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412', uuid='07452882-6f7c-42c9-a561-800356006fcc'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637945.8382618) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:45.843220 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:45.843363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:45.847200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:45.850134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:45.850134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:45.850134 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:45.850134 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:45.850134 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:45.853430 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:45.853774 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:45.853774 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:45.853774 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:45.853935 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:45.854235 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:45.854235 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:45.854341 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:45.876897 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:45.890954 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe6d:3148', 'fe80::c021:89ff:fe1f:37d3'] 
May 13 02:05:45.890954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:45.891698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:45.891698 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:45.891814 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating existing volume attachment record: 32d09b0e-7f40-4b0e-bcfd-e4a61714bf2a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:45.905085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:05:45.905085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:45.905085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:45.905085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:45.905085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:05:45.931180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:45.932726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:45.932726 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:45.933755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:45.935492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:45.935771 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:45.955878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:45.955878 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:45.972777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:45.972777 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:45.982426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b] added
May 13 02:05:45.982426 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:45.982426 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:45.982426 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:45.982426 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:45.982426 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:45.982426 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:45.982735 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:45.982965 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0502(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:45.983209 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:45.991594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b] added
May 13 02:05:45.991594 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:45.991594 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:45.991594 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:45.991594 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:45.991594 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:45.991594 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:45.992265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:45.993069 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0569(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:45.993069 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:46.031411 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:46.036424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:46.066900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cf823caa-536c-49a7-9d90-1cdbf9c76d1d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.724s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:46.075989 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:46.075989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:46.075989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:46.076265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:46.076396 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:46.076577 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-1d4b7436-363b-450a-a895-7575e85097f3 req-373de330-fe61-4cd9-b465-afd71ece9149 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received unexpected event network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de for instance with vm_state active and task_state None.
May 13 02:05:46.221914 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:46.321265 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:46.322811 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:46.323107 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Creating image(s)
May 13 02:05:46.323824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:46.323942 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:46.325259 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:46.325999 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:46.331563 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:46.337932 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:46.342673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:46.401728 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Successfully updated port: 68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:46.459211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:46.459834 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:46.460820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:46.461274 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:46.466760 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:46.466950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:46.559700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:46.560889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:46.595052 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:46.621278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk 1073741824" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:46.621829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:46.622264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:46.731624 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:46.732784 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:46.733216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:46.749779 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:46.812193 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:46.813611 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Cannot resize image /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:46.813876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:46.814148 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Ensure instance console log exists: /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:46.814374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:46.814651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:46.814771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:46.905410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:46.905547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquired lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:46.905681 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:46.961681 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:46.961824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:46.961882 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No VIF found with MAC fa:16:3e:7e:07:a8, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:46.983780 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:46.993500 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:47.000946 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:47.000946 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:47.015126 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:47.015126 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.020025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.033585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.045375 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Rebuilding instance
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.050121 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.057497 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.058019 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:47.097653 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.40.100,3260]
May 13 02:05:47.097653 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.40.100,3260] successful.
May 13 02:05:47.097653 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.101743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e24fbbe4-d330-40e0-8228-7ed42ec535e0 req-26714553-f3b1-46cd-844f-139fb9395e5c service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:47.112537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.121448 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.50.100,3260]
May 13 02:05:47.121448 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.50.100,3260] successful.
May 13 02:05:47.121448 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.131187 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.131636 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:47.131893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:47.131893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:47.132824 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('13', '-', '-', 0) found on session 35 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:47.132936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:47.144271 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:47.158541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 35 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:47.158890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:47.168440 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:47.168440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:47.169394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('14', '-', '-', 0) found on session 36 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:47.169394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:47.189323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 36 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:47.189323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:47.316477 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:47.472576 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-232440299', uuid='7a5cc9f0-2163-4891-a47e-5a5647066474'), owner=OwnerMeta(userid='4ebfe9f4cab0466b93295e0e3b02ab7b', username='tempest-TaggedAttachmentsTest-2007551033-project-member', projectid='3417bbe722944360a9197829e22c0cf0', projectname='tempest-TaggedAttachmentsTest-2007551033'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637947.471779) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:47.473328 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:05:47</nova:creationTime>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     <nova:port uuid="4c04d792-7bf7-4791-9065-b0f3552370de">
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:05:47.473328 np0000000663 nova-compute[98103]:  {{(pid=98103) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 02:05:47.502938 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:47.503965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-3ecf5ab6-0cce-4924-8d11-577f40b5c46f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:47.504336 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:47.504935 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:47.505311 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:47.552031 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:47.587979 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Booting with volume 88d2df92-fc56-4af3-8b4d-26137721f811 at /dev/vdc
May 13 02:05:47.662159 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:47.682500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:47.710143 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:47.757039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:47.762697 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:47.780535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:47.782270 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe6d:3148', 'fe80::c021:89ff:fe1f:37d3'] 
May 13 02:05:47.782477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:47.782642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:47.782973 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:47.783289 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating existing volume attachment record: 6630e4ac-19e5-47be-9db9-824bba80141f {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:47.849789 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:47.936654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:05:47.982004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c406e708-d529-425d-94fb-29903c14db8d tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 9.341s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:48.008510 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:48.017704 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Updating instance_info_cache with network_info: [{"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:48.039398 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:48.111473 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:48.111669 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-7e905afd-8d48-4a1d-a477-afb65fc61d17. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:48.111899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:48.117519 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:48.164756 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:48.165041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:48.165164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:48.166582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:48.166764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:48.167177 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received unexpected event network-vif-plugged-4c04d792-7bf7-4791-9065-b0f3552370de for instance with vm_state active and task_state None.
May 13 02:05:48.167308 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-changed-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:48.167430 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Refreshing instance network info cache due to event network-changed-68ef1295-c720-4e83-8664-975dd772914f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:48.167576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Acquiring lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:48.313785 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:48.359747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.369217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.387313 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.406715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.436535 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.521514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Releasing lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:48.521896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Instance network_info: |[{"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:48.522382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Acquired lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:48.524499 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Start _get_guest_xml network_info=[{"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:48.525015 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Refreshing network info cache for port 68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:48.533373 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:48.534681 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1215068285', uuid='04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed'), owner=OwnerMeta(userid='72370af71c554e2ca47f00350b367fd7', username='tempest-ServersNegativeTestJSON-577826386-project-member', projectid='d404b9d2b7a545719b6529d1d75593f1', projectname='tempest-ServersNegativeTestJSON-577826386'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637948.5342474) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:48.536938 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:48.537489 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:48.541045 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:48.541378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:48.542628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:48.543019 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:48.543226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:48.543368 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:48.543526 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:48.543642 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:48.543834 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:48.543956 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:48.544122 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:48.547308 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:48.547601 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:48.547779 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:48.567847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1215068285',display_name='tempest-ServersNegativeTestJSON-server-1215068285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-1215068285',id=23,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-2v6wyrim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:45Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:48.567847 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:48.567847 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:48.568335 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lazy-loading 'pci_devices' on Instance uuid 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:48.676801 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.688911 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.702211 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.9996884709999 future=<Future at 0x705c6c7e5a30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:48.702506 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99717102999989 future=<Future at 0x705c6c7e5a30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:48.702650 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.996975627999973 future=<Future at 0x705c6c7e5a30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:48.706654 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance destroyed successfully.
May 13 02:05:48.714055 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance destroyed successfully.
May 13 02:05:48.718175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-43898191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:06Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:05:48.718175 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:48.718175 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:48.718175 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:05:48.721533 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.721923 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap998fd126-10, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:48.729184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.729184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:48.730051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.730281 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b61239aa-a22a-449c-b86b-e64dba248231) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:48.732272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:48.734380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:48.736598 np0000000663 nova-compute[98103]: INFO os_vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10')
May 13 02:05:48.740793 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:05:48.741197 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:48.741447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:48.816758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632cc1d3-dd37-4f12-85e6-25badf86278e req-be7c8846-8957-42ee-9c9c-68178d6f35bb service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:48.817729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:48.817729 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:48.958663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Found WWN 33000000004d05078 for multipath device dm-8 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:05:48.959676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.055s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:48.959994 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== connect_volume: return (3055ms) {'type': 'block', 'scsi_wwn': '33000000004d05078', 'path': '/dev/dm-8', 'multipath_id': '33000000004d05078'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:48.960187 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000004d05078', 'path': '/dev/dm-8', 'multipath_id': '33000000004d05078'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:05:48.960791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.219s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:48.961238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:05:48.961660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.018322 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [29] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.018742 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:49.018742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '29'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '30'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:05:49.019441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '30')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:49.020072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '29')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:49.020867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c7420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'): ({'sdb'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:05:49.021044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:05:49.022562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flush multipath device 3300000002430ed53 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:05:49.027376 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:49.066741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:49.074695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <uuid>04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed</uuid>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <name>instance-00000017</name>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServersNegativeTestJSON-server-1215068285</nova:name>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:48</nova:creationTime>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:user uuid="72370af71c554e2ca47f00350b367fd7">tempest-ServersNegativeTestJSON-577826386-project-member</nova:user>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:project uuid="d404b9d2b7a545719b6529d1d75593f1">tempest-ServersNegativeTestJSON-577826386</nova:project>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         <nova:port uuid="68ef1295-c720-4e83-8664-975dd772914f">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="serial">04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="uuid">04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.config"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:36:4c:f9"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <target dev="tap68ef1295-c7"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/console.log" append="off"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:49.074695 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Preparing to wait for external event network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1215068285',display_name='tempest-ServersNegativeTestJSON-server-1215068285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-1215068285',id=23,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-2v6wyrim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:45Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:49.077486 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:49.077798 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:49.078153 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:49.078838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.079159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.079214 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:49.081680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.081957 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f80c1fd1-fa73-561b-a089-4598a970a589', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.092445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.093457 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.098710 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.099269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68ef1295-c7, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.100374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68ef1295-c7, col_values=(('qos', UUID('a9920043-a676-4ae4-a4bb-09437a64f1fa')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.100374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68ef1295-c7, col_values=(('external_ids', {'iface-id': '68ef1295-c720-4e83-8664-975dd772914f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:4c:f9', 'vm-uuid': '04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.105784 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:49.109445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:49.109660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:49.111127 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.112564 np0000000663 nova-compute[98103]: INFO os_vif [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7')
May 13 02:05:49.120324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:05:49.161793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:05:49.162048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:05:49.163308 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:05:49.176409 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:05:49.176651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:05:49.190816 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.239526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260]
May 13 02:05:49.239526 np0000000663 nova-compute[98103]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260] successful.
May 13 02:05:49.239526 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.264250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.277431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.305715 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:49.317909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260]
May 13 02:05:49.317909 np0000000663 nova-compute[98103]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260] successful.
May 13 02:05:49.317909 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.321542 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:49.339842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:49.341656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:49.343889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== disconnect_volume: return (600ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:49.344189 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:05:49.344623 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deleting instance files /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463_del
May 13 02:05:49.345301 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deletion of /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463_del complete
May 13 02:05:49.463348 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:49.474122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1370512412',id=21,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-g06r6y4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:39Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=07452882-6f7c-42c9-a561-800356006fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:49.476972 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:49.480374 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:49.482368 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:49.484086 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:49.615138 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:49.665120 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:49.679422 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Updated VIF entry in instance network info cache for port 68ef1295-c720-4e83-8664-975dd772914f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:05:49.679704 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Updating instance_info_cache with network_info: [{"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:49.796225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:49.796407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:49.937211 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:49.937211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:49.937211 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Creating image(s)
May 13 02:05:49.937211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:05:49.937211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Ensure instance console log exists: /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:49.938050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:49.938528 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:49.938786 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:49.944867 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 51c00d54-54b0-41fb-af8e-2cb664c6a463 could not be found.
May 13 02:05:49.945890 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:05:49.946267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:49.946481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:49.946872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:49.947328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:05:49.947432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:49.985421 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c6160>, {}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Disconnecting from: [] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== disconnect_volume: return (37ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:49.985421 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] End _get_guest_xml xml=<domain type="qemu">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <uuid>07452882-6f7c-42c9-a561-800356006fcc</uuid>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <name>instance-00000015</name>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1370512412</nova:name>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:45</nova:creationTime>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         <nova:port uuid="301f181e-9efe-400b-afda-57ad52597154">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <system>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="serial">07452882-6f7c-42c9-a561-800356006fcc</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="uuid">07452882-6f7c-42c9-a561-800356006fcc</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </system>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <os>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </os>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <features>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </features>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   <devices>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <alias name="ua-872d3e36-4ce5-4b87-8ca7-ab80bba5928b"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-8"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <serial>872d3e36-4ce5-4b87-8ca7-ab80bba5928b</serial>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </disk>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7f:a0:2b"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <target dev="tap301f181e-9e"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </interface>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/console.log" append="off"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </serial>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <video>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </video>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </rng>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:   </devices>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: </domain>
May 13 02:05:49.988526 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Preparing to wait for external event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:49.988526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:49.991470 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1370512412',id=21,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-g06r6y4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:39Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=07452882-6f7c-42c9-a561-800356006fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:05:49.991470 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:49.993285 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:49.993285 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:05:49.993285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.993285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:49.993285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:05:49.994902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:49.995926 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84e720c5-1aae-5639-82bf-ae1929e79136', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:50.000486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:50.001233 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:50.003493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:50.007905 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:50.008073 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap301f181e-9e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:50.008441 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap301f181e-9e, col_values=(('qos', UUID('0e87f5a7-1165-4561-b960-967a7a7afc4a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:50.008620 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap301f181e-9e, col_values=(('external_ids', {'iface-id': '301f181e-9efe-400b-afda-57ad52597154', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:a0:2b', 'vm-uuid': '07452882-6f7c-42c9-a561-800356006fcc'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:50.011164 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:50.022295 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:50.023032 np0000000663 nova-compute[98103]: INFO os_vif [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e')
May 13 02:05:50.168065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-539dbd7d-3253-4d9a-a56b-80ec9502462d req-2e79b336-8978-40ac-a9a0-f74cfacfa2a3 service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:50.168065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:50.182241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-00bf6eb5-e9e2-4133-9377-544d16abee9e req-87cfd73d-f2e9-422b-bda0-3c886b335e9c service nova] Releasing lock "refresh_cache-04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:50.201418 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:50.201937 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:50.202158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:50.202317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:50.202524 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:50.202687 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received unexpected event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with vm_state active and task_state rebuilding.
May 13 02:05:50.202833 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:50.203001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:50.203758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:50.203900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:50.207127 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:50.207127 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-0991e332-d0e3-439f-bb0c-b7fdacadcbec req-cceff464-b6f6-418f-9c17-81b4586ddfbb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received unexpected event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with vm_state active and task_state rebuilding.
May 13 02:05:50.300009 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:05:50.305482 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:50.305944 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-940bccd5-2181-49f7-8df6-d4778e88d08c. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:50.306106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:50.306239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:50.306364 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:50.371622 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:50.622065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:50.639624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:50.639624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:50.639624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] No VIF found with MAC fa:16:3e:36:4c:f9, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:50.639624 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Using config drive
May 13 02:05:50.814200 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:50.886642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:50.886915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:50.893196 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:05:50.893437 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Claim successful on node np0000000663
May 13 02:05:50.950593 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:51.151308 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:51.184501 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:51.241734 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Preparing to wait for external event volume-reimaged-89609779-0fe1-4836-8b88-0fecdb74ad85 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:05:51.241955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:51.242651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:51.242897 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:51.339133 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Creating config drive at /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.config
May 13 02:05:51.345490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpij7l5vgd {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:51.421138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpij7l5vgd" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:51.550176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:51.550176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:05:51.550176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:7f:a0:2b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:05:51.550458 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Using config drive
May 13 02:05:51.579376 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:51.638412 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:51.638586 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-0787a79e-aabd-474f-9a4b-f9578c22c59b. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:51.638883 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:51.689199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69856531-08fd-49f2-9e15-29623579cfa8 req-f03c54d5-96ea-4b82-a8e5-494356fbffbf service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:51.690207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:51.690466 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:51.738120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:51.738120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:51.738120 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Attaching volume f5e32e73-b4d3-454c-94d2-0d64408effc1 to /dev/vdb
May 13 02:05:51.783936 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:51.801116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:05:51.828486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:51.864020 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:05:51.864540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:05:51.873710 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:05:51.876732 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe6d:3148', 'fe80::c021:89ff:fe1f:37d3'] 
May 13 02:05:51.877069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:05:51.877423 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:05:51.877771 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:51.878204 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating existing volume attachment record: 677c6b4d-82fc-4fde-b094-ac73593a8d46 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:05:51.955120 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:51.997763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:51.997763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.059543 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:52.106798 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.130766 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.139187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.194298 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:52.247742 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Creating config drive at /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config
May 13 02:05:52.256275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb1v80un0 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:52.277034 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.284027 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.284573 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.284815 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.285406 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.285647 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.286055 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.286299 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.286578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:05:52.286828 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:05:52.309205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpb1v80un0" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:52.333262 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:52.407460 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:52.407634 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-f226364b-9343-4b55-a3d8-f2efb251fdff. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:52.409162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:52.462390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:05:52.462947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:52.463310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:52.581949 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:52.806585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:52.932802 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.966164 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:52.974536 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:53.085047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15bcbbd4-3e44-4ab9-a591-c89d7f04875b req-8ce47626-31b9-4dbb-a0bf-f7ad0242ee7c service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:53.085997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:53.087500 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:53.153085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:53.153085 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:53.182689 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:53.186215 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:53.189053 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:53.259986 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637953.259554, 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:53.260371 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] VM Started (Lifecycle Event)
May 13 02:05:53.420664 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Successfully updated port: 41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:53.590793 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:53.658999 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:05:53.693726 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:53.765068 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:53.768186 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637953.7677946, 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:53.769125 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] VM Paused (Lifecycle Event)
May 13 02:05:53.874897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:53.924325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:54.170310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.283s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:54.170866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:05:54.172633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.367s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:54.172834 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:54.173023 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:05:54.274454 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:54.277572 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:54.376916 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:54.377078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:54.377277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:54.377448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:54.377565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:54.377671 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cc7f4ba-ff4b-42bc-9ffe-c76b9384cca1 req-9aaa0630-b8e2-473d-8440-b57b829d2e9d service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Processing event network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:54.379175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:54.379175 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:54.379907 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:54.387584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:54.391303 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Instance spawned successfully.
May 13 02:05:54.391642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:54.507153 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:54.507325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:54.507503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:54.507653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:54.507805 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] No waiting events found dispatching network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:54.507954 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received unexpected event network-vif-plugged-68ef1295-c720-4e83-8664-975dd772914f for instance with vm_state building and task_state spawning.
May 13 02:05:54.508115 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:54.510311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:54.510507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:54.510675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:54.510853 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Processing event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:54.511042 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:54.511226 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:54.511454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:54.511926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:54.515886 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:05:54.518071 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance spawned successfully.
May 13 02:05:54.518441 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:05:54.677953 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:05:54.678219 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:05:54.678502 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:54.678725 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:54.727445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.264s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:54.729775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:05:54.746831 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:54.749561 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:54.751079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:54.751678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:54.751974 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:54.752363 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:54.767734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:54.767734 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:54.774489 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:05:54.774489 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:54.780195 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:54.780526 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637954.7802968, 07452882-6f7c-42c9-a561-800356006fcc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:54.780838 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Started (Lifecycle Event)
May 13 02:05:54.783149 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1] added
May 13 02:05:54.783149 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:54.783149 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:54.783149 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:54.783149 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:54.783149 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:54.783149 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:54.784012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:54.784012 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:54.785009 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:54.788039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1] added
May 13 02:05:54.788039 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:05:54.788039 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:54.788039 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:54.788039 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:05:54.788039 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:05:54.788039 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:54.788362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:05:54.788362 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:05:54.788497 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:05:54.806552 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:05:54.911502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:54.911502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:54.911502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:54.911502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:54.911502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:54.912255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.011032 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:55.031067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.031067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.033399 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.037008 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.037933 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.038595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:05:55.056405 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:55.173342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:55.181190 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:05:55.217252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.287860 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:55.294056 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:55.325252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:55.325774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.382861 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:55.418045 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Took 9.10 seconds to spawn the instance on the hypervisor.
May 13 02:05:55.418254 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:55.439956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:55.450136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.555138 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Took 9.73 seconds to spawn the instance on the hypervisor.
May 13 02:05:55.555440 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:55.590495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:55.591524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.688290 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:05:55.714125 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Successfully created port: 4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:05:55.727058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:55.727916 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:05:55.736231 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.787045 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:55.796120 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:55.799371 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:05:55.799876 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637955.799579, 07452882-6f7c-42c9-a561-800356006fcc => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:55.800126 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Paused (Lifecycle Event)
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:55.809860 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:55.809860 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:05:55.822893 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:05:55.822893 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:55.841333 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:55.842478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.873181 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.873611 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.892510 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:55.892870 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:55.893384 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:55.898123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:55.970708 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Took 15.41 seconds to build instance.
May 13 02:05:55.972688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.40.100,3260]
May 13 02:05:55.972688 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.40.100,3260] successful.
May 13 02:05:55.972688 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:55.974529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.50.100,3260]
May 13 02:05:55.974529 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.50.100,3260] successful.
May 13 02:05:55.974529 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:56.000958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:56.011957 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:56.017876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:05:56.033840 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.040159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:05:56.045783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.046907 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.048567 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.068131 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:05:56.068558 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:05:56.072216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.318s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:56.072216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:56.080387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.329s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:56.081755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:05:56.093970 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Took 20.99 seconds to build instance.
May 13 02:05:56.095812 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] HCTL ('17', '-', '-', 0) found on session 39 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:56.096003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:56.099140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] HCTL ('18', '-', '-', 0) found on session 40 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:05:56.099140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:05:56.133195 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Searching for a device in session 39 and hctl ['17', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:56.133195 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Searching for a device in session 40 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:56.133313 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:56.178315 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.183384 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.315314 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:56.322441 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637956.3208604, 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:56.322441 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] VM Resumed (Lifecycle Event)
May 13 02:05:56.388634 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.393835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.481260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.933s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:56.492819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.492961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.600664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0a446aca-a8b5-4fa9-b5c6-0e14e2353058 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.502s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:56.633025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.636384 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.742598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.744943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.746645 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:05:56.782813 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:56.787539 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:05:56.791557 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Creating image(s)
May 13 02:05:56.792368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:56.795160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:56.795160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:56.795160 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:56.799312 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:56.800874 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.834716 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Successfully updated port: 4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:05:56.846062 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:56.852121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:56.852754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.859129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.885804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:56.886109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing instance network info cache due to event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:05:56.886531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] Acquiring lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:56.886954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] Acquired lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:56.886954 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing network info cache for port 4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:56.925510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:56.927157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:56.928017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:56.930241 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:56.932714 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:05:56.935121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:56.993411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.003006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.048378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.050531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.096134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.103718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:05:57.105824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:05:57.107348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.120984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk 1073741824" returned: 0 in 0.070s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.122101 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:57.122981 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.137896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Searching for a device in session 39 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:05:57.138263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:05:57.217380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.217873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.244021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.245253 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:05:57.246381 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.336208 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.339958 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:57.341371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:05:57.366515 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637957.36183, 07452882-6f7c-42c9-a561-800356006fcc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:05:57.372046 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Resumed (Lifecycle Event)
May 13 02:05:57.381150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:57.394343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.394915 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:57.399402 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=11924MB free_disk=74.37818145751953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:05:57.399402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:57.399402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:57.412859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:05:57.413185 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:05:57.413522 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:05:57.413649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Ensure instance console log exists: /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:05:57.416515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:57.418111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:57.418111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:57.419766 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:57.420015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:57.420297 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:57.421579 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:57.421579 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:57.426457 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Terminating instance
May 13 02:05:57.466254 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:57.507151 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:57.664823 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:57.803149 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Rescuing
May 13 02:05:57.803149 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:05:57.803149 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:57.803149 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:57.816457 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Found WWN 3300000005ade652b for multipath device dm-11 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:05:57.818008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.090s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:05:57.818860 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] <== connect_volume: return (5355ms) {'type': 'block', 'scsi_wwn': '3300000005ade652b', 'path': '/dev/dm-11', 'multipath_id': '3300000005ade652b'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:05:57.818860 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005ade652b', 'path': '/dev/dm-11', 'multipath_id': '3300000005ade652b'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:05:57.826130 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:57.881041 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:57.883055 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:05:57.885753 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:05:57.938393 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:05:57.972252 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:57.980834 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.009598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.168689 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.169212 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d60d05d3-647b-4437-b267-ec5983ebf6fd req-d87a52dc-bc9b-4f88-a244-83ea4a2ab0d3 service nova] Releasing lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:58.169835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:58.169931 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:05:58.175146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.310130 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:58.330995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Attempting to attach volume f5e32e73-b4d3-454c-94d2-0d64408effc1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:05:58.339285 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:   <alias name="ua-f5e32e73-b4d3-454c-94d2-0d64408effc1"/>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:   <serial>f5e32e73-b4d3-454c-94d2-0d64408effc1</serial>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]: </disk>
May 13 02:05:58.339285 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:05:58.343126 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Instance destroyed successfully.
May 13 02:05:58.343126 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lazy-loading 'resources' on Instance uuid 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:05:58.388621 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] During sync_power_state the instance has a pending task (rescuing). Skip.
May 13 02:05:58.388942 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999854039999946 future=<Future at 0x705c48736ae0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:05:58.504193 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:58.587494 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.587672 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1a8c3497-e0fe-475c-ad89-fccdb35ab740 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.587829 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance f757f7c1-4179-4c49-b986-a95d500f90ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.587977 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance d8e796d1-f442-4a33-935b-863c6340bbca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588687 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 7a5cc9f0-2163-4891-a47e-5a5647066474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588687 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 51c00d54-54b0-41fb-af8e-2cb664c6a463 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588687 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588687 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588687 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance df1e125d-18cb-4cef-bfc7-9612eb69b3e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588895 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.588941 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 07452882-6f7c-42c9-a561-800356006fcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.589112 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 71da4951-934a-4b63-b242-61f4e395eaf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.589598 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.589983 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:05:58.589983 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:05:58.590166 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=3200MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:05:57 up 29 min,  2 users,  load average: 9.41, 5.70, 2.73\n', 'num_instances': '14', 'num_vm_active': '12', 'num_task_None': '9', 'num_os_type_None': '14', 'num_proj_eeca98c5180647b2910bdd1f13ac4196': '2', 'io_workload': '4', 'num_proj_32377a41c4fc4e2781fdff3229fc3395': '4', 'num_proj_3417bbe722944360a9197829e22c0cf0': '1', 'num_task_rebuilding': '1', 'num_proj_0f3e57d4283544449e40b60367c11476': '1', 'num_proj_4b9a7e74db544084a4907abd0f241e8b': '1', 'num_proj_d404b9d2b7a545719b6529d1d75593f1': '2', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '2', 'num_task_rescuing': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_f2064c6bb5ec4e528d35b2ba7473eada': '1', 'num_task_deleting': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:05:58.834033 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:05:58.848295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1215068285',display_name='tempest-ServersNegativeTestJSON-server-1215068285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-1215068285',id=23,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:55Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-2v6wyrim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:55Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:05:58.848728 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "68ef1295-c720-4e83-8664-975dd772914f", "address": "fa:16:3e:36:4c:f9", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap68ef1295-c7", "ovs_interfaceid": "68ef1295-c720-4e83-8664-975dd772914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:58.850835 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:58.850835 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:05:58.854132 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:58.863480 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.865112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68ef1295-c7, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:58.870177 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.870534 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:58.874402 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.876034 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.876263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9920043-a676-4ae4-a4bb-09437a64f1fa) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:05:58.877649 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.877649 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:05:58.880694 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:05:58.884082 np0000000663 nova-compute[98103]: INFO os_vif [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:4c:f9,bridge_name='br-int',has_traffic_filtering=True,id=68ef1295-c720-4e83-8664-975dd772914f,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68ef1295-c7')
May 13 02:05:58.884510 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Deleting instance files /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed_del
May 13 02:05:58.885353 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Deletion of /opt/stack/data/nova/instances/04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed_del complete
May 13 02:05:59.077143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:59.077143 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:59.077389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:59.077575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:59.088066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] No waiting events found dispatching network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:59.088066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:05:59.088066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:59.088066 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Acquiring lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:59.088537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:59.088537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:59.088611 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] No waiting events found dispatching network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:05:59.089150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9369441-3e97-464f-a68a-6a0387c87ddc req-75627ef4-7e4a-436d-9c0e-b20b47a542ac service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-unplugged-68ef1295-c720-4e83-8664-975dd772914f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:05:59.181768 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating instance_info_cache with network_info: [{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:59.203240 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:59.264193 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:59.404296 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Took 1.47 seconds to destroy the instance on the hypervisor.
May 13 02:05:59.405223 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:05:59.405811 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:05:59.405811 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:05:59.406082 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:59.439240 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:59.466269 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating instance_info_cache with network_info: [{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:59.497008 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:05:59.620842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:59.621042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:59.684900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:59.700134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:05:59.700370 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:05:59.744629 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a36ed4e1-f070-4077-acfa-585a7cf859eb req-1e41c272-c6a0-4707-9c45-172a1e88f02b service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event volume-reimaged-89609779-0fe1-4836-8b88-0fecdb74ad85 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:59.744843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a36ed4e1-f070-4077-acfa-585a7cf859eb req-1e41c272-c6a0-4707-9c45-172a1e88f02b service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:05:59.745041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a36ed4e1-f070-4077-acfa-585a7cf859eb req-1e41c272-c6a0-4707-9c45-172a1e88f02b service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:05:59.745105 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a36ed4e1-f070-4077-acfa-585a7cf859eb req-1e41c272-c6a0-4707-9c45-172a1e88f02b service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:05:59.745194 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a36ed4e1-f070-4077-acfa-585a7cf859eb req-1e41c272-c6a0-4707-9c45-172a1e88f02b service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Processing event volume-reimaged-89609779-0fe1-4836-8b88-0fecdb74ad85 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:05:59.745844 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance event wait completed in 8 seconds for volume-reimaged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:05:59.888849 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dc2ed60b-46fb-4003-b307-fe5c6a2f318c req-ac3983c7-3850-4f83-8f00-a54273397fb7 service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Received event network-vif-deleted-68ef1295-c720-4e83-8664-975dd772914f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:05:59.888849 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-dc2ed60b-46fb-4003-b307-fe5c6a2f318c req-ac3983c7-3850-4f83-8f00-a54273397fb7 service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Neutron deleted interface 68ef1295-c720-4e83-8664-975dd772914f; detaching it from the instance and deleting it from the info cache
May 13 02:05:59.888849 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dc2ed60b-46fb-4003-b307-fe5c6a2f318c req-ac3983c7-3850-4f83-8f00-a54273397fb7 service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:05:59.941729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:59.942209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance network_info: |[{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:59.942708 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:05:59.944111 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Start _get_guest_xml network_info=[{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '71da4951-934a-4b63-b242-61f4e395eaf8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'serial': 'c6553a22-915e-4fc6-9086-13a095be0c86'}, 'attachment_id': '4fcb9035-84cc-4ff1-bcf9-a9f2d8075669', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '71da4951-934a-4b63-b242-61f4e395eaf8', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'serial': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'}, 'attachment_id': '32d09b0e-7f40-4b0e-bcfd-e4a61714bf2a', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '71da4951-934a-4b63-b242-61f4e395eaf8', 'attached_at': '', 'detached_at': '', 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'serial': '88d2df92-fc56-4af3-8b4d-26137721f811'}, 'attachment_id': '6630e4ac-19e5-47be-9db9-824bba80141f', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:59.944474 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:05:59.946470 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:59.947789 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-233058230', uuid='71da4951-934a-4b63-b242-61f4e395eaf8'), owner=OwnerMeta(userid='8201863596dd42ae8139fd90ed3eccdd', username='tempest-TaggedBootDevicesTest_v242-1173439137-project-member', projectid='f2064c6bb5ec4e528d35b2ba7473eada', projectname='tempest-TaggedBootDevicesTest_v242-1173439137'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637959.947266) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:59.948826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:59.949169 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:59.949894 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:59.950075 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:59.950935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:59.951334 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:59.951550 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:59.951682 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:59.951807 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:59.951936 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:59.952044 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:59.954065 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:59.954210 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:59.954347 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:59.954452 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:59.954567 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:59.966029 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:05:59.966762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:05:59.967011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:59.967870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:59.967870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:05:59.968510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:05:59.968877 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance network_info: |[{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:05:59.971023 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Start _get_guest_xml network_info=[{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:05:59.976170 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:05:59.977436 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='2d1c8212-2a2a-4392-89cb-410a0a987de8'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637959.977126) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:05:59.978491 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:05:59.978804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:05:59.979546 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:05:59.979735 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:05:59.980438 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:05:59.980710 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:05:59.980821 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:05:59.980912 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:05:59.981047 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:05:59.981147 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:05:59.981238 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:05:59.981381 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:05:59.981493 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:05:59.981607 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:05:59.981731 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:05:59.981848 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:05:59.990111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:59.991168 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:05:59.991809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:59.992698 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:05:59.993708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:05:59.993892 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:05:59.996770 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=24,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-og5tdiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=2d1c8212-2a2a-4392-89cb-410a0a987de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:05:59.996994 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:05:59.997492 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:05:59.998026 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:00.011946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:00.011946 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:00.013329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:00.013329 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:00.025250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86] added
May 13 02:06:00.025250 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:00.025250 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:00.025250 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:00.025250 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:00.025250 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:00.025250 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:00.025628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:00.025720 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:00.025922 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:00.029282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86] added
May 13 02:06:00.029282 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:00.029282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:00.029282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:00.029282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:00.029282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:00.029282 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:00.029563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:00.029637 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:00.029830 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:00.079858 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:00.080170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:00.080646 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] No VIF found with MAC fa:16:3e:7e:07:a8, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:00.124452 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Detaching volume baffaa32-ddfa-4dbd-a321-1bf9540bae35
May 13 02:06:00.175616 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.179267 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Attempting to driver detach volume baffaa32-ddfa-4dbd-a321-1bf9540bae35 from mountpoint /dev/vdb
May 13 02:06:00.185120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found disk vdb by alias ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:00.185753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found disk vdb by alias ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:00.185900 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Attempting to detach device vdb from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:00.186147 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <alias name="ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35"/>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <serial>baffaa32-ddfa-4dbd-a321-1bf9540bae35</serial>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:00.186147 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:00.193725 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully detached device vdb from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the persistent domain config.
May 13 02:06:00.193725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] (1/8): Attempting to detach device vdb with device alias ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35 from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:00.193725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <alias name="ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35"/>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <serial>baffaa32-ddfa-4dbd-a321-1bf9540bae35</serial>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:00.193725 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:00.202887 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:00.258327 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Booting with volume 89609779-0fe1-4836-8b88-0fecdb74ad85 at /dev/vda
May 13 02:06:00.307832 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:00.324875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:00.332308 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:00.347665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:00.396273 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dc2ed60b-46fb-4003-b307-fe5c6a2f318c req-ac3983c7-3850-4f83-8f00-a54273397fb7 service nova] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Detach interface failed, port_id=68ef1295-c720-4e83-8664-975dd772914f, reason: Instance 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:06:00.397517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:00.397754 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:00.408905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:00.410472 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe1d:2a66', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe6d:3148', 'fe80::c021:89ff:fe1f:37d3', 'fe80::fc16:3eff:fe7f:a02b'] 
May 13 02:06:00.410618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:00.410775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:00.411061 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:00.411354 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating existing volume attachment record: 9fc18aad-7ee7-4e9c-bab6-14fdd8cc7596 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:06:00.447231 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:00.502339 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <uuid>2d1c8212-2a2a-4392-89cb-410a0a987de8</uuid>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <name>instance-00000018</name>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-0</nova:name>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:59</nova:creationTime>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         <nova:port uuid="4f211add-0e46-4ffd-a752-e55248d89c33">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="serial">2d1c8212-2a2a-4392-89cb-410a0a987de8</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="uuid">2d1c8212-2a2a-4392-89cb-410a0a987de8</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.config"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:71:1d:0d"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <target dev="tap4f211add-0e"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/console.log" append="off"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:00.502339 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:00.504598 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Preparing to wait for external event network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:00.504598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:00.504598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:00.504598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:00.504598 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=24,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-og5tdiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=2d1c8212-2a2a-4392-89cb-410a0a987de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:00.504862 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:00.505552 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:00.505853 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:00.509242 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.509850 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:00.510784 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:00.512985 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.514817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e56875d-9e99-5955-b576-2058fa657463', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:00.516336 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.520600 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:00.523875 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.524162 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f211add-0e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:00.525481 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f211add-0e, col_values=(('qos', UUID('75df76d6-ae7a-4208-ad04-4edade6cd4fa')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:00.525784 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f211add-0e, col_values=(('external_ids', {'iface-id': '4f211add-0e46-4ffd-a752-e55248d89c33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:1d:0d', 'vm-uuid': '2d1c8212-2a2a-4392-89cb-410a0a987de8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:00.528477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.530849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:00.534488 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:00.537000 np0000000663 nova-compute[98103]: INFO os_vif [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e')
May 13 02:06:00.710884 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:06:00.710884 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.312s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:00.711367 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:06:00.802166 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:00.835271 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Took 1.43 seconds to deallocate network for instance.
May 13 02:06:00.884750 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637960.8825085, f757f7c1-4179-4c49-b986-a95d500f90ad => ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:00.888638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-baffaa32-ddfa-4dbd-a321-1bf9540bae35 for instance f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:00.896055 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully detached device vdb from instance f757f7c1-4179-4c49-b986-a95d500f90ad from the live domain config.
May 13 02:06:00.900959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:00.901751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:00.901941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:00.982247 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updated VIF entry in instance network info cache for port 41d2df2c-3a8f-44b4-a523-cd5a3ffbe203. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:00.982247 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:01.026551 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:01.030382 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:01.041234 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:01.041234 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:01.045395 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:01.045395 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.059203 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.064703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.076466 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.081901 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.082460 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:01.134848 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.40.100,3260]
May 13 02:06:01.134848 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.40.100,3260] successful.
May 13 02:06:01.134848 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.150280 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.150933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.50.100,3260]
May 13 02:06:01.150933 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.50.100,3260] successful.
May 13 02:06:01.150933 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.169919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.181128 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:01.184585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:01.184585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:01.184585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('7', '-', '-', 0) found on session 41 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:01.184585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:01.196919 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:01.196919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:01.201139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('8', '-', '-', 0) found on session 42 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:01.201349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:01.201855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 41 and hctl ['7', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:01.222044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 42 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:01.222326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:01.349012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:01.349012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:01.368190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:01.372442 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:01.407125 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:01.483859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:01.484276 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:01.484276 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:01.484446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:01.484553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:01.485788 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:01.485788 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8088b37a-4c01-49e5-bff6-962b3e8df2b9 req-e7970a43-f933-45e6-98b8-4953d9e43e3a service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state building and task_state spawning.
May 13 02:06:01.543717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:01.557532 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:01.673773 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999657213000091 future=<Future at 0x705c6c703ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:01.679928 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e14a9989-379f-42db-8b7c-aef17514d314 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.942s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:01.684305 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance destroyed successfully.
May 13 02:06:01.684919 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'numa_topology' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:02.063906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:02.063906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:02.063906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:71:1d:0d, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:02.063906 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Using config drive
May 13 02:06:02.117896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:02.118076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:02.120061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:02.120887 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:02.120887 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:02.120887 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e1ab437b-dde9-4bf3-904c-2f390ec6c7e6 req-c00676db-fa18-4f6e-88d4-5f6885694680 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state active and task_state rescuing.
May 13 02:06:02.200132 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Attempting a stable device rescue
May 13 02:06:02.202851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 41 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:02.203074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:02.215265 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:02.215531 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:02.453136 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:02.536188 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:06:02.542347 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:02.542843 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating image(s)
May 13 02:06:02.543225 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:06:02.543538 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Ensure instance console log exists: /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:02.543959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:02.544354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:02.544700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:02.545522 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:06:02.546293 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start _get_guest_xml network_info=[{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T02:00:05Z,direct_url=<?>,disk_format='qcow2',id=d1473902-f7a7-4b60-ab45-c49394eec657,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T02:00:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '51c00d54-54b0-41fb-af8e-2cb664c6a463', 'attached_at': '', 'detached_at': '', 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'serial': '89609779-0fe1-4836-8b88-0fecdb74ad85'}, 'attachment_id': '9fc18aad-7ee7-4e9c-bab6-14fdd8cc7596', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:02.546593 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Creating image(s)
May 13 02:06:02.547063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:02.547291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:02.547752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:02.547953 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:02.549559 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 13 02:06:02.553791 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='d1473902-f7a7-4b60-ab45-c49394eec657', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-43898191', uuid='51c00d54-54b0-41fb-af8e-2cb664c6a463'), owner=OwnerMeta(userid='58ed109293f84e5da5e931ff8db316ba', username='tempest-ServerActionsV293TestJSON-1336454500-project-member', projectid='0f3e57d4283544449e40b60367c11476', projectname='tempest-ServerActionsV293TestJSON-1336454500'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637962.551979) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:02.556574 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:02.557690 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:02.559108 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:02.559379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:02.560374 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:02.560708 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-13T02:00:05Z,direct_url=<?>,disk_format='qcow2',id=d1473902-f7a7-4b60-ab45-c49394eec657,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-13T02:00:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:02.560912 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:02.561079 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:02.561532 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:02.561682 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:02.561839 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:02.562034 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:02.562198 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:02.562364 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:02.562524 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:02.562676 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:02.562861 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51c00d54-54b0-41fb-af8e-2cb664c6a463 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:02.572550 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:02.718639 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:02.748639 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Creating config drive at /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.config
May 13 02:06:02.753859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1m5fk62y {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:02.803501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1m5fk62y" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:03.015103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Found WWN 330000000671356b0 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:03.016014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:03.018941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.114s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:03.019589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000671356b0', 'path': '/dev/dm-0', 'multipath_id': '330000000671356b0'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:03.019903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'baffaa32-ddfa-4dbd-a321-1bf9540bae35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:03.020077 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000671356b0', 'path': '/dev/dm-0', 'multipath_id': '330000000671356b0'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:03.020402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:03.049986 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:03.050639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:03.051079 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:03.051763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:03.054429 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:03.055584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:03.055584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '31')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:03.061417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35', '32')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:03.061417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48655b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:03.061417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:03.061632 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flush multipath device 3300000005660298d {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:03.079990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:03.080402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:03.080582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:03.106074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:03.153729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:03.207125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:03.207332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:03.211695 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:03.222366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:03.223630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:03.225237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.876s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:03.238659 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.280289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260]
May 13 02:06:03.280289 np0000000663 nova-compute[98103]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.40.100,3260] successful.
May 13 02:06:03.280289 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.304558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.321437 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Deleted allocations for instance 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed
May 13 02:06:03.326636 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.332227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.366746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.370814 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.381462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260]
May 13 02:06:03.381462 np0000000663 nova-compute[98103]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-baffaa32-ddfa-4dbd-a321-1bf9540bae35, portal: 192.168.50.100,3260] successful.
May 13 02:06:03.381462 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.409111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.409111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:03.409111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== disconnect_volume: return (2507ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:03.409111 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:03.411663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.331s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:03.411965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:03.428902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:03.431404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:03.439230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:03.439568 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:03.440055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:03.441888 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:03.466303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:03.466303 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.468053 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.468954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:03.468954 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85] added
May 13 02:06:03.489617 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:03.489617 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0563(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:03.489617 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85] added
May 13 02:06:03.493849 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:03.493849 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0514(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:03.493849 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:03.528971 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:03.529330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:03.529330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:03.570946 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.574987 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:03.691018 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:03.693577 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:03.693899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:03.706507 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.006720131000065521 future=<Future at 0x705c6c7e5a30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:03.706659 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:03.706827 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.68200759399997 future=<Future at 0x705c48736ae0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:03.706954 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.681853708000062 future=<Future at 0x705c48736ae0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:03.709797 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Emitting event <LifecycleEvent: 1778637948.6995466, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:03.709797 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Stopped (Lifecycle Event)
May 13 02:06:03.801461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.part --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:03.801908 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] 0f1d1cb5-8065-4a52-9a05-b9422cf5adf7 was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:06:03.802684 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:06:03.803062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.part /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:03.921515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.part /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.converted" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:03.928572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:04.010794 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'flavor' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:04.043933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540.converted --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:04.044694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.993s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.045156 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:04.048907 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:04.051050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.051050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.054517 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:04.054517 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:04.055063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:04.163600 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:04.167792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540,backing_fmt=raw /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:04.191131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:04.191874 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.192278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.192511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.192705 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:04.192883 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state active and task_state rescuing.
May 13 02:06:04.193021 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:04.193242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.193431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.193616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.193790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Processing event network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:04.193980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:04.194169 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.194598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.194763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.194931 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] No waiting events found dispatching network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:04.195073 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e50a4a10-c6ff-4457-89e5-fb9e57e510b8 req-133697aa-052f-4242-8dcd-a13bac567017 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received unexpected event network-vif-plugged-4f211add-0e46-4ffd-a752-e55248d89c33 for instance with vm_state building and task_state spawning.
May 13 02:06:04.215958 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:04.219045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7968da0443b57fb423bdfe0ce94dce6aa2404540,backing_fmt=raw /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.rescue" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:04.222191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "7968da0443b57fb423bdfe0ce94dce6aa2404540" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.222191 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'migration_context' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:04.319770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.320199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.341079 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-777b6821-3d5d-4b67-954f-8d9f12778849 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.921s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:04.363586 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637964.3629138, 2d1c8212-2a2a-4392-89cb-410a0a987de8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:04.364070 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:04.364256 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] VM Started (Lifecycle Event)
May 13 02:06:04.369055 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:04.370981 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance spawned successfully.
May 13 02:06:04.371435 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:04.489014 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:04.493871 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:04.503436 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:04.503436 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:04.509478 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:04.509478 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.519157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.524395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.537003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.537725 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:04.539807 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:04.539807 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.543517 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:04.586011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260]
May 13 02:06:04.586011 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260] successful.
May 13 02:06:04.586011 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.600545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.610485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260]
May 13 02:06:04.610485 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260] successful.
May 13 02:06:04.610485 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.622442 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] HCTL ('9', '-', '-', 0) found on session 43 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:04.622442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:04.629863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:04.644648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching for a device in session 43 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:04.645085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.657709 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:04.658017 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:04.658292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:04.658398 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:04.659654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] HCTL ('10', '-', '-', 0) found on session 44 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:04.659654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:04.683134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Searching for a device in session 44 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:04.683134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:04.724670 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:04.725161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:06:04.725908 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start _get_guest_xml network_info=[{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:7f:a0:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0f1d1cb5-8065-4a52-9a05-b9422cf5adf7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, 'status': 'reserved', 'instance': '07452882-6f7c-42c9-a561-800356006fcc', 'attached_at': '', 'detached_at': '', 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'serial': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b'}, 'attachment_id': '890a68ad-65b9-429f-af66-65a4b3a3cd4b', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:04.726130 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:04.826438 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:04.867617 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:04.871032 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:04.879540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:04.879540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:04.880031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:04.880277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:04.880574 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:04.881272 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:05.020125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9579e693-8c52-437c-b3d4-6dbb00d2a946 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.399s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:05.042192 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Detaching volume f5e32e73-b4d3-454c-94d2-0d64408effc1
May 13 02:06:05.102808 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Attempting to driver detach volume f5e32e73-b4d3-454c-94d2-0d64408effc1 from mountpoint /dev/vdb
May 13 02:06:05.113293 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Found disk vdb by alias ua-f5e32e73-b4d3-454c-94d2-0d64408effc1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:05.117953 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Found disk vdb by alias ua-f5e32e73-b4d3-454c-94d2-0d64408effc1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:05.118160 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Attempting to detach device vdb from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:05.118514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <alias name="ua-f5e32e73-b4d3-454c-94d2-0d64408effc1"/>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <serial>f5e32e73-b4d3-454c-94d2-0d64408effc1</serial>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:05.118514 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:05.131783 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully detached device vdb from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the persistent domain config.
May 13 02:06:05.131988 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] (1/8): Attempting to detach device vdb with device alias ua-f5e32e73-b4d3-454c-94d2-0d64408effc1 from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:05.132228 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <alias name="ua-f5e32e73-b4d3-454c-94d2-0d64408effc1"/>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <serial>f5e32e73-b4d3-454c-94d2-0d64408effc1</serial>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:05.132228 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:05.177646 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:05.231113 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:05.233074 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:05.234671 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412', uuid='07452882-6f7c-42c9-a561-800356006fcc'), owner=OwnerMeta(userid='ab7be413eb9340d1af627622a3e917fe', username='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member', projectid='32377a41c4fc4e2781fdff3229fc3395', projectname='tempest-ServerBootFromVolumeStableRescueTest-1279205887'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:7f:a0:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637965.2342596) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:05.236125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:05.236437 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:05.237420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:05.237628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:05.239016 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:05.239489 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:05.239703 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:05.239840 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:05.240026 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:05.240189 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:05.240377 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:05.240538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:05.240670 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:05.240821 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:05.240969 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:05.241227 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:05.241439 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:05.375555 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:05.375820 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637965.375578, 2d1c8212-2a2a-4392-89cb-410a0a987de8 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:05.376182 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] VM Paused (Lifecycle Event)
May 13 02:06:05.389278 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Took 8.62 seconds to spawn the instance on the hypervisor.
May 13 02:06:05.389513 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:05.438712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:05.540020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:05.674752 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f5e32e73-b4d3-454c-94d2-0d64408effc1 for instance 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:05.743671 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:05.772060 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:05.832026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:05.876116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:05.876313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:05.876568 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:05.877190 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:05.877683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:05.878173 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:05.879239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:05.879467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:05.881893 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637965.8816006, 2d1c8212-2a2a-4392-89cb-410a0a987de8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:05.882102 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] VM Resumed (Lifecycle Event)
May 13 02:06:05.899340 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Took 15.09 seconds to build instance.
May 13 02:06:06.097212 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:06.097497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:06.097782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:06.097987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:06.098176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:06.102784 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Terminating instance
May 13 02:06:06.384825 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:06.387078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:06.402005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.605s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:06.457030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Found WWN 3300000002430ed53 for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:06.457587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:06.457653 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== connect_volume: return (3376ms) {'type': 'block', 'scsi_wwn': '3300000002430ed53', 'path': '/dev/dm-1', 'multipath_id': '3300000002430ed53'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:06.458216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002430ed53', 'path': '/dev/dm-1', 'multipath_id': '3300000002430ed53'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:06.458999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.929s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:06.459326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:06.475615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:06.476212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:06.476557 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:06.476832 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:06.480115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:06.480115 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:06.490556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:06.490556 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:06.496830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:06.496830 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:06.505144 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f] added
May 13 02:06:06.505144 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:06.505144 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:06.505144 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:06.505144 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:06.505144 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:06.505144 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:06.505611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:06.505611 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:06.505692 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:06.511467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f] added
May 13 02:06:06.511467 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:06.511467 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:06.511467 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:06.511467 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:06.511467 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:06.511467 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:06.511652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:06.511847 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:06.512170 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:06.606401 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:06.648452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.655760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.678820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.807409 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.830863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.880670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:06.880911 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:06.881163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:06.881325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:06.881513 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:06.881688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-595a6e91-e5f2-4056-918c-676c4e0d0b35 req-7b549441-54cc-4468-8946-862c2903e53c service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:06.889945 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637966.8895857, 7a5cc9f0-2163-4891-a47e-5a5647066474 => ua-f5e32e73-b4d3-454c-94d2-0d64408effc1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:06.896421 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully detached device vdb from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the live domain config.
May 13 02:06:06.898493 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:06.898756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:06.898899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:06.939253 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:06.941345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:06.941483 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Attaching volume 232e0c08-22bd-4016-8c81-34014f81eb27 to /dev/vdb
May 13 02:06:06.967026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-43898191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:06Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:06.967808 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:06.968559 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:06.972184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <uuid>51c00d54-54b0-41fb-af8e-2cb664c6a463</uuid>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <name>instance-00000010</name>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsV293TestJSON-server-43898191</nova:name>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:02</nova:creationTime>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:image uuid="d1473902-f7a7-4b60-ab45-c49394eec657">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:user uuid="58ed109293f84e5da5e931ff8db316ba">tempest-ServerActionsV293TestJSON-1336454500-project-member</nova:user>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:project uuid="0f3e57d4283544449e40b60367c11476">tempest-ServerActionsV293TestJSON-1336454500</nova:project>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid="d1473902-f7a7-4b60-ab45-c49394eec657"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         <nova:port uuid="998fd126-103d-4849-a998-cf1a294e7fed">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="serial">51c00d54-54b0-41fb-af8e-2cb664c6a463</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="uuid">51c00d54-54b0-41fb-af8e-2cb664c6a463</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <alias name="ua-89609779-0fe1-4836-8b88-0fecdb74ad85"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <serial>89609779-0fe1-4836-8b88-0fecdb74ad85</serial>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:78:d0:35"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <target dev="tap998fd126-10"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/console.log" append="off"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:06.972184 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-43898191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:06Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.975947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:06.981462 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:06.981971 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999703197999906 future=<Future at 0x705c4875fe00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:06.985208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.985536 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76463694-c980-5634-9e43-121bccb6964b', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:06.988119 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Instance destroyed successfully.
May 13 02:06:06.989472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:06.990808 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:06.993239 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'resources' on Instance uuid f757f7c1-4179-4c49-b986-a95d500f90ad {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:07.002390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.007485 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:07.008285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.008607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap998fd126-10, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:07.009023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap998fd126-10, col_values=(('qos', UUID('8b698204-b891-4878-9e48-2d881bc8973d')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:07.009171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap998fd126-10, col_values=(('external_ids', {'iface-id': '998fd126-103d-4849-a998-cf1a294e7fed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d0:35', 'vm-uuid': '51c00d54-54b0-41fb-af8e-2cb664c6a463'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:07.010150 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.011435 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:07.021055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:07.031681 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.035380 np0000000663 nova-compute[98103]: INFO os_vif [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10')
May 13 02:06:07.045738 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:07.045924 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing instance network info cache due to event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:07.049611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] Acquiring lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:07.049611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] Acquired lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:07.050272 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing network info cache for port 4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:07.058937 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:07.107746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:07.108145 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:07.118170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:07.119745 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe7e:7a8', 'fe80::284b:5bff:fe87:75b0', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe93:588b', 'fe80::d068:bbff:fe8f:a813', 'fe80::fc16:3eff:feff:d318', 'fe80::1cfc:85ff:feb1:d481', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe6d:3148', 'fe80::c021:89ff:fe1f:37d3', 'fe80::fc16:3eff:fe71:1d0d'] 
May 13 02:06:07.119917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:07.120030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:07.120296 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:07.120542 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updating existing volume attachment record: 0b937c6b-9170-4f6e-85ef-b578335935fd {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:06:07.498118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-585778022',display_name='tempest-ServerActionsTestOtherA-server-1540344872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-tempest-common-compute-instance-585778022',id=12,image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE38m6uqC/4bcTdeKgdAGPOcDRNlPQsG7RpNT0kUF398H0lObjFYjG8dtoK7nOwkzxSLaxCtqu8l6EWxgo69BW277T3KUy/gT7SGZp2e45L+jtOgqSoGm2E669rWwDfryg==',key_name='tempest-keypair-1491008453',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:21Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-iyhi2ne8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=f757f7c1-4179-4c49-b986-a95d500f90ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:07.498118 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "77e46685-d447-44ae-a646-bea635926fda", "address": "fa:16:3e:1d:2a:66", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e46685-d4", "ovs_interfaceid": "77e46685-d447-44ae-a646-bea635926fda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:07.498118 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:07.498118 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:07.500562 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.502021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e46685-d4, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:07.503036 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.504396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:07.506437 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:07.512795 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:07.518325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.518942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.519464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=075224f6-c01d-4dd8-ac63-a9ce4f7987b4) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:07.520517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.521028 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:07.524726 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:07.524726 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:07.533387 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:07.533387 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.539260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:07.539260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.544134 np0000000663 nova-compute[98103]: INFO os_vif [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:2a:66,bridge_name='br-int',has_traffic_filtering=True,id=77e46685-d447-44ae-a646-bea635926fda,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e46685-d4')
May 13 02:06:07.544134 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Deleting instance files /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad_del
May 13 02:06:07.544476 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Deletion of /opt/stack/data/nova/instances/f757f7c1-4179-4c49-b986-a95d500f90ad_del complete
May 13 02:06:07.546459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.556868 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.557175 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:07.564265 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.570793 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.571070 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:07.619781 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.40.100,3260]
May 13 02:06:07.619781 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.40.100,3260] successful.
May 13 02:06:07.619781 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.630960 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.50.100,3260]
May 13 02:06:07.630960 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.50.100,3260] successful.
May 13 02:06:07.630960 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.640462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.650634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.677979 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.678842 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.679440 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:07.679729 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:07.679969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:07.680424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:07.683157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:07.683157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:07.685183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:07.685735 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:07.686236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:07.687550 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('19', '-', '-', 0) found on session 45 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:07.687785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:07.688800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('20', '-', '-', 0) found on session 46 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:07.688949 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:07.706817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 45 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:07.707104 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:07.718710 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 46 and hctl ['20', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:08.007975 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:08.057085 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Took 1.45 seconds to destroy the instance on the hypervisor.
May 13 02:06:08.061177 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:08.061658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:08.061807 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:08.062023 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:08.126117 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:08.169341 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updated VIF entry in instance network info cache for port 4f211add-0e46-4ffd-a752-e55248d89c33. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:08.169689 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating instance_info_cache with network_info: [{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:08.509886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:08.511603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:08.576588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:08.576949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:08.576949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] No VIF found with MAC fa:16:3e:78:d0:35, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:08.577649 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Using config drive
May 13 02:06:08.671956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2d12263-06cd-4458-be0f-38f5cac21006 req-4386e2cd-c527-47ce-99b8-25d4c8ad9503 service nova] Releasing lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:08.719458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 46 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:08.719879 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:08.981814 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:08.981980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] Acquiring lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:08.982959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:08.982959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:08.982959 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] No waiting events found dispatching network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:08.982959 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9c74a3-21f5-44b4-835c-f947bc9191ef req-822c852d-1ea6-4caf-af63-8f35f2cfd8c9 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-unplugged-77e46685-d447-44ae-a646-bea635926fda for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:09.014626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:06:09.074892 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:09.081428 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lazy-loading 'ec2_ids' on Instance uuid 51c00d54-54b0-41fb-af8e-2cb664c6a463 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:09.111644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8e84db0b-5ff8-4aad-8bb2-716cea38b347 req-3b5228f2-32cf-4a88-89bb-421d984d3d78 service nova] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Received event network-vif-deleted-77e46685-d447-44ae-a646-bea635926fda {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:09.501030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Found WWN 33000000028554f03 for multipath device dm-14 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:09.501360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:09.501527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== connect_volume: return (5971ms) {'type': 'block', 'scsi_wwn': '33000000028554f03', 'path': '/dev/dm-14', 'multipath_id': '33000000028554f03'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:09.501663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028554f03', 'path': '/dev/dm-14', 'multipath_id': '33000000028554f03'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:09.502343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.623s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:09.502632 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:09.515011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:09.515866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:09.518378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:09.518378 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:09.520248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:09.520453 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:09.533119 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:09.533119 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:09.536456 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:09.536456 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:09.545140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:09.548562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.562132 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.562980 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:09.562980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:09.563806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('13', '0', '0', 0) found on session 35 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:09.563806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.571771 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:09.573478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 35 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:09.573781 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:09.574170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:09.574375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:09.574484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:09.575921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] HCTL ('14', '0', '0', 0) found on session 36 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:09.576034 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:09.577656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Took 1.52 seconds to deallocate network for instance.
May 13 02:06:09.585323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Searching for a device in session 36 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:09.585543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:09.586044 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Object Instance<51c00d54-54b0-41fb-af8e-2cb664c6a463> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:09.586223 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lazy-loading 'keypairs' on Instance uuid 51c00d54-54b0-41fb-af8e-2cb664c6a463 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:09.594898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:09.594898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:09.599993 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:09.601690 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Claim successful on node np0000000663
May 13 02:06:10.006428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:10.006851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:10.007019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:10.084134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:10.088991 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Object Instance<51c00d54-54b0-41fb-af8e-2cb664c6a463> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:10.095166 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 13 02:06:10.147915 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:06:10.180823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:10.231382 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Creating config drive at /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config
May 13 02:06:10.238000 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2w7krob {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:10.307945 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn2w7krob" returned: 0 in 0.071s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:10.518342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:10.789981 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:10.831971 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:10.840125 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:10.915639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.088272 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:11.089532 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:11.089810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:11.089985 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:11.090181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:11.090367 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db61288f-c879-4526-b3d3-5f4a36e5f161 req-ed316845-6ffa-4d28-bb81-0cd0a117860d service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received unexpected event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with vm_state active and task_state rebuild_spawning.
May 13 02:06:11.140183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:11.140388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:11.140599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:11.140743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:11.140880 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:11.144459 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Terminating instance
May 13 02:06:11.152141 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.161892 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.190166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.195764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.542005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Found WWN 33000000004d05078 for multipath device dm-8 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:11.543370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:11.545004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== connect_volume: return (5664ms) {'type': 'block', 'scsi_wwn': '33000000004d05078', 'path': '/dev/dm-8', 'multipath_id': '33000000004d05078'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:11.545524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000004d05078', 'path': '/dev/dm-8', 'multipath_id': '33000000004d05078'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:11.546052 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.647s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:11.548063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f5e32e73-b4d3-454c-94d2-0d64408effc1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:11.548063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:11.573715 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:11.573873 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:11.593077 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:11.594014 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:11.594421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '39'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:11.594520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '40')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:11.596356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1', '39')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:11.596991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c4b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:11.597913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:11.598679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Flush multipath device 3300000005ade652b {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:11.637901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:11.656740 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:11.687756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:11.688556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.694223 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.723241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.724440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.728809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:11.729003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:11.730729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:11.750513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:11.750729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:11.764654 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.769389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.818081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.40.100,3260]
May 13 02:06:11.818081 np0000000663 nova-compute[98103]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.40.100,3260] successful.
May 13 02:06:11.818081 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.847574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.862450 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.892494 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637971.8917198, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:11.892835 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Resumed (Lifecycle Event)
May 13 02:06:11.895037 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:11.895037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:11.899343 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance spawned successfully.
May 13 02:06:11.901063 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:11.904167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.50.100,3260]
May 13 02:06:11.904167 np0000000663 nova-compute[98103]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-f5e32e73-b4d3-454c-94d2-0d64408effc1, portal: 192.168.50.100,3260] successful.
May 13 02:06:11.904167 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.916809 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:11.918004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:11.918004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:11.918004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:11.918004 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] No waiting events found dispatching network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:11.918004 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-04f6529b-f06b-4f78-ac50-81c9edd50936 req-4d213204-a4c8-4b70-b0a3-2a599fd7dd72 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:11.932627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.932627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:11.932822 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] <== disconnect_volume: return (5034ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:11.932949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:11.935497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.249s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:11.935497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:11.955588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:11.956024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:11.956243 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:11.960124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:11.960124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:11.960124 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:11.971568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:11.971568 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.982571 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:11.982571 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.987720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:11.991927 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27] added
May 13 02:06:11.991927 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:11.991927 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:11.991927 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:11.991927 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:11.991927 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:11.991927 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.992144 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:11.992291 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:11.992478 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:11.995053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27] added
May 13 02:06:11.995053 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:11.995053 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:11.995053 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:11.995053 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:11.995053 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:11.995053 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:11.995309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:11.995439 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:11.995595 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:12.006900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.020852 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Instance destroyed successfully.
May 13 02:06:12.021461 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lazy-loading 'resources' on Instance uuid df1e125d-18cb-4cef-bfc7-9612eb69b3e1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:12.059219 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1370512412',id=21,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:55Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-g06r6y4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:56Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=07452882-6f7c-42c9-a561-800356006fcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:7f:a0:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:12.059504 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "vif_mac": "fa:16:3e:7f:a0:2b"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:12.059916 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:12.060569 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'pci_devices' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:12.079210 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:12.397261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:12.399126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:12.407460 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.407626 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.407913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.408184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.408492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.408743 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:12.495819 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:12.522427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.524594 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-362211948',display_name='tempest-ServersNegativeTestJSON-server-362211948',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serversnegativetestjson-server-362211948',id=19,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:37Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d404b9d2b7a545719b6529d1d75593f1',ramdisk_id='',reservation_id='r-90v6pvvh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-577826386',owner_user_name='tempest-ServersNegativeTestJSON-577826386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:37Z,user_data=None,user_id='72370af71c554e2ca47f00350b367fd7',uuid=df1e125d-18cb-4cef-bfc7-9612eb69b3e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:12.524834 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converting VIF {"id": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "address": "fa:16:3e:ff:d3:18", "network": {"id": "e780cafc-9630-4147-88ef-c43fae8f7041", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-885070007-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d404b9d2b7a545719b6529d1d75593f1", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapad69885c-53", "ovs_interfaceid": "ad69885c-5302-4944-a8f3-444ac7ffe95a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:12.525535 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:12.525852 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:12.531268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.531268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad69885c-53, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:12.532527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:12.537136 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.538732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.538732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54a37e5b-9faf-4102-834a-cd38cb9cec90) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:12.539474 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:12.545316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:12.547183 np0000000663 nova-compute[98103]: INFO os_vif [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d3:18,bridge_name='br-int',has_traffic_filtering=True,id=ad69885c-5302-4944-a8f3-444ac7ffe95a,network=Network(e780cafc-9630-4147-88ef-c43fae8f7041),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad69885c-53')
May 13 02:06:12.547581 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Deleting instance files /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1_del
May 13 02:06:12.548617 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Deletion of /opt/stack/data/nova/instances/df1e125d-18cb-4cef-bfc7-9612eb69b3e1_del complete
May 13 02:06:12.562636 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:12.564005 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <uuid>07452882-6f7c-42c9-a561-800356006fcc</uuid>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <name>instance-00000015</name>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1370512412</nova:name>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:05</nova:creationTime>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:user uuid="ab7be413eb9340d1af627622a3e917fe">tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member</nova:user>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:project uuid="32377a41c4fc4e2781fdff3229fc3395">tempest-ServerBootFromVolumeStableRescueTest-1279205887</nova:project>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         <nova:port uuid="301f181e-9efe-400b-afda-57ad52597154">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="serial">07452882-6f7c-42c9-a561-800356006fcc</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="uuid">07452882-6f7c-42c9-a561-800356006fcc</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <alias name="ua-872d3e36-4ce5-4b87-8ca7-ab80bba5928b"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-8"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <serial>872d3e36-4ce5-4b87-8ca7-ab80bba5928b</serial>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.rescue"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <boot order="1"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7f:a0:2b"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <target dev="tap301f181e-9e"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/console.log" append="off"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:12.564005 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:12.570719 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance destroyed successfully.
May 13 02:06:12.588559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.994s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:12.588961 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:06:12.592085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.508s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:12.901369 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 13 02:06:12.901653 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637972.9014525, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:12.902103 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Started (Lifecycle Event)
May 13 02:06:12.916202 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:12.995563 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:12.996235 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:13.013759 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:13.013759 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:13.016550 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:13.016550 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.032055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.040900 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.058414 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.059558 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:13.064778 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:06:13.067893 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:13.068323 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:13.068811 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:13.068811 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.071161 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.071545 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:13.100690 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:06:13.104647 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:06:13.105504 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:13.106517 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:13.134151 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.40.100,3260]
May 13 02:06:13.134151 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.40.100,3260] successful.
May 13 02:06:13.134151 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.144894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.50.100,3260]
May 13 02:06:13.144894 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.50.100,3260] successful.
May 13 02:06:13.144894 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.146460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.162367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.179513 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.179842 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:13.181492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:13.181492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:13.185548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:13.186627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:13.187568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('17', '-', '-', 0) found on session 47 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:13.187704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:13.188083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.188467 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:13.188703 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:13.188939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:13.188998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:13.190919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:13.192323 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:13.195447 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-14cb2492-9c7e-4828-9738-8e1a8c6fa737 req-4b0209c4-a7bf-4bb1-a3d3-681b05358fcb service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received unexpected event network-vif-plugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with vm_state active and task_state None.
May 13 02:06:13.199042 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('18', '-', '-', 0) found on session 48 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:13.199042 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:13.218624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 47 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:13.218624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:13.222758 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:06:13.230565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 48 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:13.230565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:13.239600 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:13.389766 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0009089469999707944 future=<Future at 0x705c48736ae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:13.392129 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Emitting event <LifecycleEvent: 1778637958.388728, 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:13.392129 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:13.392324 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] VM Stopped (Lifecycle Event)
May 13 02:06:13.392796 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.2805504479999854 future=<Future at 0x705c6c703ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:13.393493 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.279859903999977 future=<Future at 0x705c6c703ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:13.406173 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:13.410385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:13.432530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:13.549266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:13.550336 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:13.616468 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:06:13.623581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f13873e-8942-4c89-bf64-3a4216da3196 req-285dadb2-e2fa-47c9-aeca-2ab964ad1c08 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-deleted-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:13.623812 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-4f13873e-8942-4c89-bf64-3a4216da3196 req-285dadb2-e2fa-47c9-aeca-2ab964ad1c08 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Neutron deleted interface ad69885c-5302-4944-a8f3-444ac7ffe95a; detaching it from the instance and deleting it from the info cache
May 13 02:06:13.623994 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4f13873e-8942-4c89-bf64-3a4216da3196 req-285dadb2-e2fa-47c9-aeca-2ab964ad1c08 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:13.873933 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Successfully created port: cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:06:13.895549 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 04a0c9b6-acd1-4d04-bf72-ad6e67ae88ed] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:13.921119 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99975085799997 future=<Future at 0x705c48689b80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:13.959250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:14.020193 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:14.020735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] Acquiring lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:14.020921 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:14.021262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:14.021479 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] No waiting events found dispatching network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:14.021644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3590084-6572-4730-abfb-43224c30fa2b req-b987a348-b078-46b4-a7b9-c0982c46787c service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Received event network-vif-unplugged-ad69885c-5302-4944-a8f3-444ac7ffe95a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:14.022500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca118d47-0d3a-4b75-8c80-a6092351f19b tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 9.483s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:14.048450 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:14.052426 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:14.076266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-4c04d792-7bf7-4791-9065-b0f3552370de" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:14.076266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-4c04d792-7bf7-4791-9065-b0f3552370de" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:14.096321 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:14.098473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:14.098473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:14.098473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] No VIF found with MAC fa:16:3e:7f:a0:2b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:14.098473 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Using config drive
May 13 02:06:14.121912 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:06:14.131012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f13873e-8942-4c89-bf64-3a4216da3196 req-285dadb2-e2fa-47c9-aeca-2ab964ad1c08 service nova] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Detach interface failed, port_id=ad69885c-5302-4944-a8f3-444ac7ffe95a, reason: Instance df1e125d-18cb-4cef-bfc7-9612eb69b3e1 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:06:14.484218 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Successfully updated port: cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:06:14.550922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Took 1.48 seconds to deallocate network for instance.
May 13 02:06:14.562956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.971s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:14.565956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 1.132s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:14.565956 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98103) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 13 02:06:14.589828 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:14.602146 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'ec2_ids' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:14.650970 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Deleted allocations for instance f757f7c1-4179-4c49-b986-a95d500f90ad
May 13 02:06:14.973226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found WWN 33000000061caa1b9 for multipath device dm-11 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:14.973665 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:14.973878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== connect_volume: return (7288ms) {'type': 'block', 'scsi_wwn': '33000000061caa1b9', 'path': '/dev/dm-11', 'multipath_id': '33000000061caa1b9'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:14.974044 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000061caa1b9', 'path': '/dev/dm-11', 'multipath_id': '33000000061caa1b9'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:14.974457 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.968s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:14.974867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:14.977672 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:14.986886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:14.988245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:14.989316 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:14.989316 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:14.989316 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:14.990265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:14.990514 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:14.991037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:14.991264 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:15.003202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:15.003202 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:15.015139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:15.015139 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:15.019181 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811] added
May 13 02:06:15.019181 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:15.019181 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:15.019181 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:15.019181 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:15.019181 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:15.019181 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:15.019519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:15.019568 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:15.019697 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:15.026818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811] added
May 13 02:06:15.026818 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:15.026818 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:15.026818 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:15.026818 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:15.026818 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:15.026818 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:15.027159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:15.027159 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:15.027247 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:15.057508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:15.098117 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:15.098117 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:15.098117 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:15.098855 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:15.100454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:15.102001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Attempting to detach device tap4c04d792-7b from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:15.102238 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] detach device xml: <interface type="ethernet">
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:   <mac address="fa:16:3e:6d:31:48"/>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:   <model type="virtio"/>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:   <driver name="qemu"/>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:   <mtu size="1372"/>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:   <target dev="tap4c04d792-7b"/>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]: </interface>
May 13 02:06:15.102238 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:15.105821 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:15.107419 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:15.107865 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface>not found in domain: <domain type='qemu' id='18'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <name>instance-0000000f</name>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <uuid>7a5cc9f0-2163-4891-a47e-5a5647066474</uuid>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:05:47</nova:creationTime>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <nova:port uuid="4c04d792-7bf7-4791-9065-b0f3552370de">
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <memory unit='KiB'>196608</memory>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <vcpu placement='static'>1</vcpu>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <resource>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <partition>/machine</partition>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </resource>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <sysinfo type='smbios'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='product'>OpenStack Nova</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='version'>33.1.0</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='serial'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='uuid'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <entry name='family'>Virtual Machine</entry>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <boot dev='hd'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <smbios mode='sysinfo'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <vmcoreinfo state='on'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <cpu mode='custom' match='exact' check='full'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <model fallback='forbid'>Nehalem</model>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <feature policy='require' name='hypervisor'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <clock offset='utc'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <on_poweroff>destroy</on_poweroff>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <on_reboot>restart</on_reboot>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <on_crash>destroy</on_crash>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <disk type='file' device='disk'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk' index='2'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <backingStore type='file' index='3'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:         <format type='raw'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:         <source file='/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:         <backingStore/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       </backingStore>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target dev='vda' bus='virtio'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='virtio-disk0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <disk type='file' device='cdrom'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <driver name='qemu' type='raw' cache='none'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config' index='1'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <backingStore/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target dev='hda' bus='ide'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <readonly/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='ide0-0-0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <controller type='usb' index='0' model='none'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='usb'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <controller type='pci' index='0' model='pci-root'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='pci.0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <controller type='ide' index='0'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='ide'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <interface type='ethernet'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <mac address='fa:16:3e:7e:07:a8'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target dev='tapef65e23b-b9'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <model type='virtio'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <driver name='qemu'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <mtu size='1372'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='net0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <interface type='ethernet'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <mac address='fa:16:3e:6d:31:48'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target dev='tap4c04d792-7b'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <model type='virtio'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <driver name='qemu'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <mtu size='1372'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='net1'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <serial type='pty'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target type='isa-serial' port='0'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:         <model name='isa-serial'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       </target>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <console type='pty' tty='/dev/pts/0'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <target type='serial' port='0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </console>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <input type='mouse' bus='ps2'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='input0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <input type='keyboard' bus='ps2'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='input1'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <listen type='address' address='0.0.0.0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </graphics>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <audio id='1' type='none'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <model type='virtio' heads='1' primary='yes'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='video0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <stats period='10'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='balloon0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <rng model='virtio'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <backend model='random'>/dev/urandom</backend>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <alias name='rng0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <label>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</label>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <imagelabel>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</imagelabel>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <label>+64055:+993</label>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:     <imagelabel>+64055:+993</imagelabel>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:15.107865 np0000000663 nova-compute[98103]:  {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 02:06:15.111835 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'keypairs' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:15.111835 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully detached device tap4c04d792-7b from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the persistent domain config.
May 13 02:06:15.111835 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] (1/8): Attempting to detach device tap4c04d792-7b with device alias net1 from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:15.111835 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] detach device xml: <interface type="ethernet">
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:   <mac address="fa:16:3e:6d:31:48"/>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:   <model type="virtio"/>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:   <driver name="qemu"/>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:   <mtu size="1372"/>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:   <target dev="tap4c04d792-7b"/>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]: </interface>
May 13 02:06:15.111835 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:15.130814 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:06:15.132028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:15.132345 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Creating image(s)
May 13 02:06:15.132864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:15.133176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:15.135472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:15.136144 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:15.139967 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:15.141117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.185619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:15.249006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.249432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:15.249839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:15.250271 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:15.252923 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:15.253242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.341792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.342464 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.414502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk 1073741824" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.415230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.165s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:15.415707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.479927 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Attempting to attach volume 232e0c08-22bd-4016-8c81-34014f81eb27 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:06:15.482386 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:   <alias name="ua-232e0c08-22bd-4016-8c81-34014f81eb27"/>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:   <serial>232e0c08-22bd-4016-8c81-34014f81eb27</serial>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:15.482386 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:06:15.513115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.513875 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:06:15.513875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.581441 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a36ed4e1-f070-4077-acfa-585a7cf859eb tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.016s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:15.584267 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.527s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:15.594446 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:15.611797 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:15.615873 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:15.620167 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.620798 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:06:15.621137 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:06:15.621363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Ensure instance console log exists: /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:15.621788 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:15.622015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:15.622234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:15.674423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61650d55-aae0-48b5-8db7-5eaac03e2092 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "f757f7c1-4179-4c49-b986-a95d500f90ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.577s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:15.823815 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Creating config drive at /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config.rescue
May 13 02:06:15.827952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xiqo1l6 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:15.891183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xiqo1l6" returned: 0 in 0.063s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:15.904117 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:16.021810 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:16.028392 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:16.052429 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:16.052429 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:16.056399 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:16.056399 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.078168 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.085972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.104799 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.106716 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.119082 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.119634 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:16.131314 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating instance_info_cache with network_info: [{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:16.147595 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:16.151461 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing instance network info cache due to event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:16.151712 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] Acquiring lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:16.197032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.40.100,3260]
May 13 02:06:16.197032 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.40.100,3260] successful.
May 13 02:06:16.197032 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.204136 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.50.100,3260]
May 13 02:06:16.204136 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.50.100,3260] successful.
May 13 02:06:16.204136 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.221681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.230163 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.255988 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.259119 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:16.259119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.263190 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:16.263580 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:16.264023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.274s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:16.264542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:16.264984 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Start waiting for the detach event from libvirt for device tap4c04d792-7b with device alias net1 for instance 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:16.265807 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637976.2655046, 7a5cc9f0-2163-4891-a47e-5a5647066474 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:16.266435 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:16.268516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('21', '-', '-', 0) found on session 49 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:16.268516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:16.277993 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.286136 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface>not found in domain: <domain type='qemu' id='18'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <name>instance-0000000f</name>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <uuid>7a5cc9f0-2163-4891-a47e-5a5647066474</uuid>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:05:47</nova:creationTime>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <nova:port uuid="4c04d792-7bf7-4791-9065-b0f3552370de">
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.10.10.104" ipVersion="4"/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <memory unit='KiB'>196608</memory>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <vcpu placement='static'>1</vcpu>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <resource>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <partition>/machine</partition>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </resource>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <sysinfo type='smbios'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='product'>OpenStack Nova</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='version'>33.1.0</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='serial'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='uuid'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <entry name='family'>Virtual Machine</entry>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <boot dev='hd'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <smbios mode='sysinfo'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <vmcoreinfo state='on'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <cpu mode='custom' match='exact' check='full'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <model fallback='forbid'>Nehalem</model>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <feature policy='require' name='hypervisor'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <clock offset='utc'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <on_poweroff>destroy</on_poweroff>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <on_reboot>restart</on_reboot>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <on_crash>destroy</on_crash>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <disk type='file' device='disk'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk' index='2'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <backingStore type='file' index='3'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:         <format type='raw'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:         <source file='/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:         <backingStore/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       </backingStore>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <target dev='vda' bus='virtio'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='virtio-disk0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <disk type='file' device='cdrom'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <driver name='qemu' type='raw' cache='none'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config' index='1'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <backingStore/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <target dev='hda' bus='ide'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <readonly/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='ide0-0-0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <controller type='usb' index='0' model='none'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='usb'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <controller type='pci' index='0' model='pci-root'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='pci.0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <controller type='ide' index='0'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='ide'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <interface type='ethernet'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <mac address='fa:16:3e:7e:07:a8'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <target dev='tapef65e23b-b9'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <model type='virtio'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <driver name='qemu'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <mtu size='1372'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='net0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <serial type='pty'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <target type='isa-serial' port='0'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:         <model name='isa-serial'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       </target>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <console type='pty' tty='/dev/pts/0'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <target type='serial' port='0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </console>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <input type='mouse' bus='ps2'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='input0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <input type='keyboard' bus='ps2'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='input1'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <listen type='address' address='0.0.0.0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </graphics>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <audio id='1' type='none'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <model type='virtio' heads='1' primary='yes'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='video0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <stats period='10'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='balloon0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <rng model='virtio'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <backend model='random'>/dev/urandom</backend>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <alias name='rng0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <label>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</label>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <imagelabel>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</imagelabel>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <label>+64055:+993</label>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:     <imagelabel>+64055:+993</imagelabel>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:16.286136 np0000000663 nova-compute[98103]:  {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 02:06:16.289657 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully detached device tap4c04d792-7b from instance 7a5cc9f0-2163-4891-a47e-5a5647066474 from the live domain config.
May 13 02:06:16.289657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:16.289657 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:16.289657 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:16.289657 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:16.293569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.293809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c04d792-7b, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:16.299497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.299497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:16.301509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 49 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:16.304972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:16.304972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] HCTL ('22', '-', '-', 0) found on session 50 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:16.304972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:16.308327 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.311142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.312339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.312985 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2679ce61-315e-4393-839e-5d6dda6c3f1c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:16.313716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.315113 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:16.324147 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.325967 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.340683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Searching for a device in session 50 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:16.344852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:16.344852 np0000000663 nova-compute[98103]: INFO os_vif [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b')
May 13 02:06:16.348137 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-232440299', uuid='7a5cc9f0-2163-4891-a47e-5a5647066474'), owner=OwnerMeta(userid='4ebfe9f4cab0466b93295e0e3b02ab7b', username='tempest-TaggedAttachmentsTest-2007551033-project-member', projectid='3417bbe722944360a9197829e22c0cf0', projectname='tempest-TaggedAttachmentsTest-2007551033'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637976.3444448) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:16.348137 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:06:16</nova:creationTime>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:16.348137 np0000000663 nova-compute[98103]:  {{(pid=98103) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 02:06:16.360049 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:16.360049 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:16.364329 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.567746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.599671 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.604377 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.637072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:16.637072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Instance network_info: |[{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:06:16.640250 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Start _get_guest_xml network_info=[{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:16.641686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] Acquired lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:16.642005 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:16.644719 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:16.646489 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='49cb3e10-5cb6-4107-a854-b913e5ec46b1'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637976.6456685) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:16.648238 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:16.648238 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:16.649773 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:16.649866 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:16.651514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:16.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:16.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:16.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:16.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:16.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:16.652942 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:16.653357 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:16.653525 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:16.653750 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:16.653891 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:16.654125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:16.670420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=25,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-gcl8q3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=49cb3e10-5cb6-4107-a854-b913e5ec46b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:16.670939 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:16.671552 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:16.673019 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:16.681870 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.008480405000000246 future=<Future at 0x705c6c703ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:16.681998 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:16.682129 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.299526572999866 future=<Future at 0x705c4875fe00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:16.685163 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.299418001000049 future=<Future at 0x705c4875fe00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:16.687187 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Emitting event <LifecycleEvent: 1778637961.6732626, 07452882-6f7c-42c9-a561-800356006fcc => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:16.690545 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Stopped (Lifecycle Event)
May 13 02:06:16.739527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.745729 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:16.777475 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:16.777786 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:16.989446 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:17.147671 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:17.205188 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <uuid>49cb3e10-5cb6-4107-a854-b913e5ec46b1</uuid>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <name>instance-00000019</name>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-1</nova:name>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:16</nova:creationTime>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         <nova:port uuid="cb6d0be5-c6c1-46f7-9be7-cc1a008d8241">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="serial">49cb3e10-5cb6-4107-a854-b913e5ec46b1</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="uuid">49cb3e10-5cb6-4107-a854-b913e5ec46b1</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.config"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:83:8d:ae"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <target dev="tapcb6d0be5-c6"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/console.log" append="off"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:17.205188 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:17.207832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7c377583-0d70-4802-898f-55a24a060bec tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:17.207832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Preparing to wait for external event network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:17.207832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:17.207832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:17.207832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=25,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-gcl8q3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=49cb3e10-5cb6-4107-a854-b913e5ec46b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:17.210857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:17.211547 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.211547 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acbe3b53-c3ec-5d99-aaeb-857585f39113', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:17.212781 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.214812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:17.216047 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:17.216224 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:17.218426 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:17.218604 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:93:58:8b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:17.220955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.227990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.227990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb6d0be5-c6, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:17.227990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb6d0be5-c6, col_values=(('qos', UUID('d9c066ec-0b74-400f-b914-589d0c6004ae')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:17.227990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb6d0be5-c6, col_values=(('external_ids', {'iface-id': 'cb6d0be5-c6c1-46f7-9be7-cc1a008d8241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8d:ae', 'vm-uuid': '49cb3e10-5cb6-4107-a854-b913e5ec46b1'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:17.227990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.230109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:17.238086 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:17.240518 np0000000663 nova-compute[98103]: INFO os_vif [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6')
May 13 02:06:17.280767 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:17.555904 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:17.685347 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637977.6849597, 07452882-6f7c-42c9-a561-800356006fcc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:17.685741 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Resumed (Lifecycle Event)
May 13 02:06:17.691952 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a7a7212-4c37-4e18-bb4f-53250ffc3704 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:17.722464 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updated VIF entry in instance network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:17.722464 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating instance_info_cache with network_info: [{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:17.789628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.205s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:17.863009 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Deleted allocations for instance df1e125d-18cb-4cef-bfc7-9612eb69b3e1
May 13 02:06:18.016111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Found WWN 330000000b6a0f122 for multipath device dm-15 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:18.016549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:18.016802 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== connect_volume: return (8010ms) {'type': 'block', 'scsi_wwn': '330000000b6a0f122', 'path': '/dev/dm-15', 'multipath_id': '330000000b6a0f122'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:18.016977 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6a0f122', 'path': '/dev/dm-15', 'multipath_id': '330000000b6a0f122'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:18.191352 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:18.197361 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:18.227628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a4835f31-eb89-4df8-b105-48beaa58737b req-c47b8d81-b7c3-4e7e-a514-25eab32c93f1 service nova] Releasing lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:18.257545 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received unexpected event network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de for instance with vm_state active and task_state None.
May 13 02:06:18.259117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:18.259383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:18.259383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:18.259521 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:18.259694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:18.259824 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received unexpected event network-vif-unplugged-4c04d792-7bf7-4791-9065-b0f3552370de for instance with vm_state active and task_state None.
May 13 02:06:18.259941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-deleted-4c04d792-7bf7-4791-9065-b0f3552370de {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:18.260115 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Neutron deleted interface 4c04d792-7bf7-4791-9065-b0f3552370de; detaching it from the instance and deleting it from the info cache
May 13 02:06:18.260395 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:18.532587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.535888 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.537273 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.537273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.538474 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.538474 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.538474 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.539315 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.539315 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.539822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.539963 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.540893 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.543297 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.544036 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:18.544417 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:18.544804 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:18.546039 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lazy-loading 'pci_devices' on Instance uuid 71da4951-934a-4b63-b242-61f4e395eaf8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:18.648876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:18.649012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquired lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:18.649061 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:18.700778 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637978.700428, 07452882-6f7c-42c9-a561-800356006fcc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:18.701222 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Started (Lifecycle Event)
May 13 02:06:18.766468 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lazy-loading 'system_metadata' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:18.769968 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:18.773124 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:18.773124 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:83:8d:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:18.773124 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Using config drive
May 13 02:06:18.805819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4b273503-e48d-405b-8b5b-8234d185b6d7 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.866s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:18.872700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-39cc1458-c1e9-43ef-b755-79ff9b46f298 tempest-ServersNegativeTestJSON-577826386 tempest-ServersNegativeTestJSON-577826386-project-member] Lock "df1e125d-18cb-4cef-bfc7-9612eb69b3e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.732s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.036205 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Unrescuing
May 13 02:06:19.036564 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:19.036724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquired lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:19.036869 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:19.049113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <uuid>71da4951-934a-4b63-b242-61f4e395eaf8</uuid>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <name>instance-00000016</name>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:name>tempest-device-tagging-server-233058230</nova:name>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:05:59</nova:creationTime>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:user uuid="8201863596dd42ae8139fd90ed3eccdd">tempest-TaggedBootDevicesTest_v242-1173439137-project-member</nova:user>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:project uuid="f2064c6bb5ec4e528d35b2ba7473eada">tempest-TaggedBootDevicesTest_v242-1173439137</nova:project>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="427e00b4-93dd-4fa7-9124-1214b806e8d0">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="3ecf5ab6-0cce-4924-8d11-577f40b5c46f">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="7e905afd-8d48-4a1d-a477-afb65fc61d17">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="940bccd5-2181-49f7-8df6-d4778e88d08c">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="f226364b-9343-4b55-a3d8-f2efb251fdff">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.1.149" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="0787a79e-aabd-474f-9a4b-f9578c22c59b">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         <nova:port uuid="41d2df2c-3a8f-44b4-a523-cd5a3ffbe203">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="serial">71da4951-934a-4b63-b242-61f4e395eaf8</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="uuid">71da4951-934a-4b63-b242-61f4e395eaf8</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/disk.config"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <alias name="ua-c6553a22-915e-4fc6-9086-13a095be0c86"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <serial>c6553a22-915e-4fc6-9086-13a095be0c86</serial>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <alias name="ua-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-14"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <serial>c3bfb2e9-1ce3-463a-8a86-5332d8158e3f</serial>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <alias name="ua-88d2df92-fc56-4af3-8b4d-26137721f811"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-15"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="vdc" bus="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <serial>88d2df92-fc56-4af3-8b4d-26137721f811</serial>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:21:38:e5"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap427e00b4-93"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:39:6b:71"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap3ecf5ab6-0c"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7e:25:ce"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap7e905afd-8d"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:5f:d2:73"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap940bccd5-21"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:30:d1:cd"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tapf226364b-93"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:63:fa:99"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap0787a79e-aa"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:51:cc:0c"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <target dev="tap41d2df2c-3a"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/console.log" append="off"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:19.049113 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Preparing to wait for external event network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.056561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.057672 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.057672 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.057672 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.060299 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.063685 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.064452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.064452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.065748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.066123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37644ef7-f330-57e4-bfd6-3b021071fbc2', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.066953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.069398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.073902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.076111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.076333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap427e00b4-93, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.079171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap427e00b4-93, col_values=(('qos', UUID('ce2a8eb1-a7b5-40ef-85c5-b5238e5ab398')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.079171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap427e00b4-93, col_values=(('external_ids', {'iface-id': '427e00b4-93dd-4fa7-9124-1214b806e8d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:38:e5', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.079171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.079564 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.089298 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.090438 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93')
May 13 02:06:19.091137 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.091348 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.091841 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.092054 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.092443 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.092651 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.092928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.093812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.093962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cccaa749-853e-5371-8a71-d8e14dd0bdb8', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.094789 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.095471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.107822 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.111300 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.111497 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ecf5ab6-0c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.111813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ecf5ab6-0c, col_values=(('qos', UUID('3ba1af2e-73f1-4360-b3e6-f4b220d4c212')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.111969 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ecf5ab6-0c, col_values=(('external_ids', {'iface-id': '3ecf5ab6-0cce-4924-8d11-577f40b5c46f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:6b:71', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.112938 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.114219 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.131714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.132718 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c')
May 13 02:06:19.133378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.133543 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.133987 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.134248 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.134553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.134753 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.134916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.136944 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.137115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '528c171b-cb33-5ee7-bcdf-342359b1ce72', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.137946 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.138536 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.151753 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:19.169956 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.171895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.172022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e905afd-8d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.172325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e905afd-8d, col_values=(('qos', UUID('5aa984c5-abd6-45b9-a9a3-d91010426b93')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.172458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e905afd-8d, col_values=(('external_ids', {'iface-id': '7e905afd-8d48-4a1d-a477-afb65fc61d17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:25:ce', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.173164 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.174223 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.195558 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.196861 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d')
May 13 02:06:19.197748 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.197969 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.198731 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.198997 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.199293 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.199468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.199619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.200747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.200906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96e9d381-bd95-5c54-994c-ba414b989fee', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.201571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.202108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.206344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:19.215467 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:19.226087 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.230405 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.230633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap940bccd5-21, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.231029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap940bccd5-21, col_values=(('qos', UUID('587346ef-cc15-42ae-9a5c-890f713713cc')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.231220 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap940bccd5-21, col_values=(('external_ids', {'iface-id': '940bccd5-2181-49f7-8df6-d4778e88d08c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:d2:73', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.240706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.263389 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.264861 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21')
May 13 02:06:19.266417 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.267408 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.268038 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.268356 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.269194 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.270615 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lazy-loading 'flavor' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:19.274459 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.278358 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:19.280289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.282071 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.282432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac8a8926-5323-54ff-a874-7f8ab7050a6e', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.286642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.287464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.317160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.326144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.326144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf226364b-93, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.326144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf226364b-93, col_values=(('qos', UUID('ef6b1bf5-d6f6-4fd0-9920-949d49654349')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.326144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf226364b-93, col_values=(('external_ids', {'iface-id': 'f226364b-9343-4b55-a3d8-f2efb251fdff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:d1:cd', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.331309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.359624 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.360057 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93')
May 13 02:06:19.360763 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.360944 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.361473 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.361676 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.362123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.362123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.362458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.364172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.364978 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbe42ba6-61c7-57c3-a531-86f8d90f3015', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.369982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.400914 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.404678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.404678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0787a79e-aa, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.404678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0787a79e-aa, col_values=(('qos', UUID('a1b0fe69-ad6b-4f21-a890-275a12a5cf20')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.404678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0787a79e-aa, col_values=(('external_ids', {'iface-id': '0787a79e-aabd-474f-9a4b-f9578c22c59b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:fa:99', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.408005 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.440759 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Creating config drive at /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.config
May 13 02:06:19.441442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.441661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.447118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.450439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaaj8k96n {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:19.450958 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa')
May 13 02:06:19.452222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:19.470131 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.472686 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.473391 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:19.480646 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.483418 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.484900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.487849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.488044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20ca1ed9-bd6d-53ef-a11d-6affd29e9210', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.490826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.511141 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaaj8k96n" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:19.535443 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.539219 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:19.542757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.542757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d2df2c-3a, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.543124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41d2df2c-3a, col_values=(('qos', UUID('fd8bfc84-1f43-47ad-8a89-fa99ec5abc23')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.543411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41d2df2c-3a, col_values=(('external_ids', {'iface-id': '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:cc:0c', 'vm-uuid': '71da4951-934a-4b63-b242-61f4e395eaf8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.546369 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.550156 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:19.595970 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.597783 np0000000663 nova-compute[98103]: INFO os_vif [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a')
May 13 02:06:19.686924 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:19.717200 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 02:06:19.788226 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Object Instance<7a5cc9f0-2163-4891-a47e-5a5647066474> lazy-loaded attributes: system_metadata,flavor {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:19.789357 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:19.789869 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.792075 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.803204 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:19.811958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface>not found in domain: <domain type='qemu' id='18'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <name>instance-0000000f</name>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <uuid>7a5cc9f0-2163-4891-a47e-5a5647066474</uuid>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:06:16</nova:creationTime>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <memory unit='KiB'>196608</memory>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <vcpu placement='static'>1</vcpu>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <resource>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <partition>/machine</partition>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </resource>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <sysinfo type='smbios'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='product'>OpenStack Nova</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='version'>33.1.0</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='serial'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='uuid'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <entry name='family'>Virtual Machine</entry>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <boot dev='hd'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <smbios mode='sysinfo'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <vmcoreinfo state='on'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <cpu mode='custom' match='exact' check='full'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <model fallback='forbid'>Nehalem</model>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <feature policy='require' name='hypervisor'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <clock offset='utc'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <on_poweroff>destroy</on_poweroff>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <on_reboot>restart</on_reboot>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <on_crash>destroy</on_crash>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <disk type='file' device='disk'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk' index='2'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <backingStore type='file' index='3'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:         <format type='raw'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:         <source file='/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:         <backingStore/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       </backingStore>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <target dev='vda' bus='virtio'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='virtio-disk0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <disk type='file' device='cdrom'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <driver name='qemu' type='raw' cache='none'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config' index='1'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <backingStore/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <target dev='hda' bus='ide'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <readonly/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='ide0-0-0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <controller type='usb' index='0' model='none'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='usb'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <controller type='pci' index='0' model='pci-root'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='pci.0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <controller type='ide' index='0'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='ide'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <interface type='ethernet'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <mac address='fa:16:3e:7e:07:a8'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <target dev='tapef65e23b-b9'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <model type='virtio'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <driver name='qemu'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <mtu size='1372'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='net0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <serial type='pty'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <target type='isa-serial' port='0'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:         <model name='isa-serial'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       </target>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <console type='pty' tty='/dev/pts/0'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <target type='serial' port='0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </console>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <input type='mouse' bus='ps2'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='input0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <input type='keyboard' bus='ps2'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='input1'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <listen type='address' address='0.0.0.0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </graphics>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <audio id='1' type='none'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <model type='virtio' heads='1' primary='yes'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='video0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <stats period='10'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='balloon0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <rng model='virtio'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <backend model='random'>/dev/urandom</backend>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <alias name='rng0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <label>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</label>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <imagelabel>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</imagelabel>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <label>+64055:+993</label>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:     <imagelabel>+64055:+993</imagelabel>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:19.811958 np0000000663 nova-compute[98103]:  {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 02:06:19.815708 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface> {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 13 02:06:19.823359 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:6d:31:48"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap4c04d792-7b"/></interface>not found in domain: <domain type='qemu' id='18'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <name>instance-0000000f</name>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <uuid>7a5cc9f0-2163-4891-a47e-5a5647066474</uuid>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:06:16</nova:creationTime>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <memory unit='KiB'>196608</memory>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <currentMemory unit='KiB'>196608</currentMemory>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <vcpu placement='static'>1</vcpu>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <resource>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <partition>/machine</partition>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </resource>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <sysinfo type='smbios'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='product'>OpenStack Nova</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='version'>33.1.0</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='serial'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='uuid'>7a5cc9f0-2163-4891-a47e-5a5647066474</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <entry name='family'>Virtual Machine</entry>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <boot dev='hd'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <smbios mode='sysinfo'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <vmcoreinfo state='on'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <tb-cache unit='KiB'>131072</tb-cache>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <cpu mode='custom' match='exact' check='full'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <model fallback='forbid'>Nehalem</model>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <feature policy='require' name='hypervisor'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <clock offset='utc'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <on_poweroff>destroy</on_poweroff>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <on_reboot>restart</on_reboot>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <on_crash>destroy</on_crash>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <disk type='file' device='disk'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <driver name='qemu' type='qcow2' cache='none'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk' index='2'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <backingStore type='file' index='3'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:         <format type='raw'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:         <source file='/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:         <backingStore/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       </backingStore>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <target dev='vda' bus='virtio'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='virtio-disk0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <disk type='file' device='cdrom'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <driver name='qemu' type='raw' cache='none'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <source file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/disk.config' index='1'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <backingStore/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <target dev='hda' bus='ide'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <readonly/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='ide0-0-0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <controller type='usb' index='0' model='none'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='usb'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <controller type='pci' index='0' model='pci-root'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='pci.0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <controller type='ide' index='0'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='ide'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </controller>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <interface type='ethernet'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <mac address='fa:16:3e:7e:07:a8'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <target dev='tapef65e23b-b9'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <model type='virtio'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <driver name='qemu'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <mtu size='1372'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='net0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <serial type='pty'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <target type='isa-serial' port='0'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:         <model name='isa-serial'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       </target>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <console type='pty' tty='/dev/pts/0'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <source path='/dev/pts/0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <log file='/opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474/console.log' append='off'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <target type='serial' port='0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='serial0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </console>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <input type='mouse' bus='ps2'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='input0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <input type='keyboard' bus='ps2'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='input1'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </input>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <listen type='address' address='0.0.0.0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </graphics>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <audio id='1' type='none'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <model type='virtio' heads='1' primary='yes'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='video0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <stats period='10'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='balloon0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <rng model='virtio'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <backend model='random'>/dev/urandom</backend>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <alias name='rng0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <label>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</label>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <imagelabel>libvirt-7a5cc9f0-2163-4891-a47e-5a5647066474</imagelabel>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <label>+64055:+993</label>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:     <imagelabel>+64055:+993</imagelabel>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:   </seclabel>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:19.823359 np0000000663 nova-compute[98103]:  {{(pid=98103) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 13 02:06:19.823359 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Detaching interface fa:16:3e:6d:31:48 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap4c04d792-7b' not found.
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000000663',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Converting VIF {"id": "4c04d792-7bf7-4791-9065-b0f3552370de", "address": "fa:16:3e:6d:31:48", "network": {"id": "0278991a-cdad-4146-873e-db103180eda5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2107102017", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c04d792-7b", "ovs_interfaceid": "4c04d792-7bf7-4791-9065-b0f3552370de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG os_vif [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c04d792-7b, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:19.828501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:19.831929 np0000000663 nova-compute[98103]: INFO os_vif [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:31:48,bridge_name='br-int',has_traffic_filtering=True,id=4c04d792-7bf7-4791-9065-b0f3552370de,network=Network(0278991a-cdad-4146-873e-db103180eda5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c04d792-7b')
May 13 02:06:19.833926 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-232440299', uuid='7a5cc9f0-2163-4891-a47e-5a5647066474'), owner=OwnerMeta(userid='4ebfe9f4cab0466b93295e0e3b02ab7b', username='tempest-TaggedAttachmentsTest-2007551033-project-member', projectid='3417bbe722944360a9197829e22c0cf0', projectname='tempest-TaggedAttachmentsTest-2007551033'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637979.8325722) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:19.833926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:package version="33.1.0"/>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:name>tempest-device-tagging-server-232440299</nova:name>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:creationTime>2026-05-13 02:06:19</nova:creationTime>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:flavor name="m1.nano" id="42">
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:memory>192</nova:memory>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:disk>1</nova:disk>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:swap>0</nova:swap>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:vcpus>1</nova:vcpus>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:extraSpecs>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     </nova:extraSpecs>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   </nova:flavor>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:minDisk>1</nova:minDisk>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:minRam>0</nova:minRam>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:properties>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     </nova:properties>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   </nova:image>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:owner>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:user uuid="4ebfe9f4cab0466b93295e0e3b02ab7b">tempest-TaggedAttachmentsTest-2007551033-project-member</nova:user>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:project uuid="3417bbe722944360a9197829e22c0cf0">tempest-TaggedAttachmentsTest-2007551033</nova:project>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   </nova:owner>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   <nova:ports>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     <nova:port uuid="ef65e23b-b93f-4302-b817-cde4b9f86590">
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:       <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:     </nova:port>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:   </nova:ports>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]: </nova:instance>
May 13 02:06:19.833926 np0000000663 nova-compute[98103]:  {{(pid=98103) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 13 02:06:19.836128 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:19.836403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.836703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state rescued and task_state None.
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:19.838270 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e829765a-49bc-44a2-911e-49849cd8c78a req-f667867c-69f4-4d26-9e1f-c6ecc1e2bba2 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state rescued and task_state None.
May 13 02:06:19.928619 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [{"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:19.947007 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Detaching volume 232e0c08-22bd-4016-8c81-34014f81eb27
May 13 02:06:20.004253 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Attempting to driver detach volume 232e0c08-22bd-4016-8c81-34014f81eb27 from mountpoint /dev/vdb
May 13 02:06:20.031277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-232e0c08-22bd-4016-8c81-34014f81eb27 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:20.033343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-232e0c08-22bd-4016-8c81-34014f81eb27 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:20.033486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Attempting to detach device vdb from instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:20.033771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <alias name="ua-232e0c08-22bd-4016-8c81-34014f81eb27"/>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <serial>232e0c08-22bd-4016-8c81-34014f81eb27</serial>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:20.033771 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:20.045494 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 from the persistent domain config.
May 13 02:06:20.045789 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] (1/8): Attempting to detach device vdb with device alias ua-232e0c08-22bd-4016-8c81-34014f81eb27 from instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:20.046218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <alias name="ua-232e0c08-22bd-4016-8c81-34014f81eb27"/>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <serial>232e0c08-22bd-4016-8c81-34014f81eb27</serial>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:20.046218 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:20.095946 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:20.162826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.237754 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.239405 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.311055 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.324031 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating instance_info_cache with network_info: [{"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:20.356171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.394084 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:20.433371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Releasing lock "refresh_cache-7a5cc9f0-2163-4891-a47e-5a5647066474" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:20.516948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4521236-24c4-4a15-bb74-4042123d8439 req-d9ee56ea-9b9e-4355-a69f-ec065fcda0d4 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:20.516948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4521236-24c4-4a15-bb74-4042123d8439 req-d9ee56ea-9b9e-4355-a69f-ec065fcda0d4 service nova] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:20.517138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4521236-24c4-4a15-bb74-4042123d8439 req-d9ee56ea-9b9e-4355-a69f-ec065fcda0d4 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:20.517270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4521236-24c4-4a15-bb74-4042123d8439 req-d9ee56ea-9b9e-4355-a69f-ec065fcda0d4 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:20.517669 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4521236-24c4-4a15-bb74-4042123d8439 req-d9ee56ea-9b9e-4355-a69f-ec065fcda0d4 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Processing event network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:20.627111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:20.628802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:20.829978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Releasing lock "refresh_cache-07452882-6f7c-42c9-a561-800356006fcc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:20.829978 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'flavor' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:20.873609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778637980.8732073, 73e6d52d-6b8e-4ddc-926a-19f2df275829 => ua-232e0c08-22bd-4016-8c81-34014f81eb27> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:20.875827 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-232e0c08-22bd-4016-8c81-34014f81eb27 for instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:20.879013 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance 73e6d52d-6b8e-4ddc-926a-19f2df275829 from the live domain config.
May 13 02:06:20.881687 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:20.881687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:20.881687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:20.882064 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:20.882338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '232e0c08-22bd-4016-8c81-34014f81eb27', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:20.882507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:20.922831 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:20.923533 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:20.923533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', '47')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:20.924952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27', '48')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:20.926540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c88287920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:20.926800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:20.927041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flush multipath device 33000000061caa1b9 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:20.942651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a3584b72-a422-46b3-8f94-8a34c6a3c267 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "interface-7a5cc9f0-2163-4891-a47e-5a5647066474-4c04d792-7bf7-4791-9065-b0f3552370de" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.866s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:20.960348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:21.010101 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:21.053418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:21.053644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:21.056307 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:21.075672 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:21.076769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:21.094611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.132903 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:06:21.151609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:21.151609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:21.151609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] No VIF found with MAC fa:16:3e:21:38:e5, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:21.151609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] No VIF found with MAC fa:16:3e:30:d1:cd, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:21.152121 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Using config drive
May 13 02:06:21.155529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.40.100,3260]
May 13 02:06:21.155529 np0000000663 nova-compute[98103]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.40.100,3260] successful.
May 13 02:06:21.155529 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.191032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.208565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.254480 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.50.100,3260]
May 13 02:06:21.254480 np0000000663 nova-compute[98103]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-232e0c08-22bd-4016-8c81-34014f81eb27, portal: 192.168.50.100,3260] successful.
May 13 02:06:21.254480 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.273434 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637981.2729173, 49cb3e10-5cb6-4107-a854-b913e5ec46b1 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:21.273606 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] VM Started (Lifecycle Event)
May 13 02:06:21.275001 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:21.279769 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:21.283891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:21.284076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:21.285917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== disconnect_volume: return (402ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:21.285917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:21.288055 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Instance spawned successfully.
May 13 02:06:21.291511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:21.619332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:21.627955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:21.655863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:21.663564 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:21.746124 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance destroyed successfully.
May 13 02:06:21.746972 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'numa_topology' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:21.780226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:21.781159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:21.782608 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:21.787913 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:21.788495 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Claim successful on node np0000000663
May 13 02:06:21.798725 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:21.804475 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.804582 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.805969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.805969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.805969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.809392 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:21.838032 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:21.891829 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:21.897685 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:21.902559 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:21.902750 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:21.903677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:21.907416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:21.907563 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:21.907687 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-77a5ef94-2017-40c6-bb93-499eff137b59 req-5e3e463b-da54-4aeb-a8c9-06ad30452c2f service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state rescued and task_state unrescuing.
May 13 02:06:21.982076 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004017630001271755 future=<Future at 0x705c4875fe00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:21.983395 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778637966.981567, f757f7c1-4179-4c49-b986-a95d500f90ad => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:21.984856 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:21.985137 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] VM Stopped (Lifecycle Event)
May 13 02:06:21.986601 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.932169335000026 future=<Future at 0x705c48689b80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:21.986991 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.931777727000053 future=<Future at 0x705c48689b80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:22.004798 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Creating config drive at /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/disk.config
May 13 02:06:22.013130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpglytpy6g {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:22.082012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpglytpy6g" returned: 0 in 0.069s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:22.243750 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:22.245330 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:22.249230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:22.249230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:22.249455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:22.253051 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Object Instance<07452882-6f7c-42c9-a561-800356006fcc> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:06:22.255595 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Terminating instance
May 13 02:06:22.310955 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:22.314574 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637982.3140721, 49cb3e10-5cb6-4107-a854-b913e5ec46b1 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:22.314808 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] VM Paused (Lifecycle Event)
May 13 02:06:22.318918 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Took 7.19 seconds to spawn the instance on the hypervisor.
May 13 02:06:22.319168 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:22.488620 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23f0505b-60ad-49e6-a024-e4a6237e97ea tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: f757f7c1-4179-4c49-b986-a95d500f90ad] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:22.586994 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:22.586994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:22.587184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:22.587302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:22.587433 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] No waiting events found dispatching network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:22.590135 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-9cc1bc58-53c0-4911-9911-5ab1b76f32d9 req-5dac80ab-9794-4f91-88c4-9e133e84400b service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received unexpected event network-vif-plugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 for instance with vm_state active and task_state None.
May 13 02:06:22.769610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:22.821675 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:22.826463 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637982.8247108, 49cb3e10-5cb6-4107-a854-b913e5ec46b1 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:22.826463 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] VM Resumed (Lifecycle Event)
May 13 02:06:22.841429 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Took 13.32 seconds to build instance.
May 13 02:06:22.851314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:22.880513 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:22.883385 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:22.905983 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7845b00e-2958-4e98-99e1-64debd918ded tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.464s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:22.961059 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.014916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.088360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.166398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.242154 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.294112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.331344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:23.335897 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:23.345455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.835s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:23.417233 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.473074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.528742 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.533882 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.566205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.604614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.718152 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.736178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:23.736523 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:23.750690 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Instance destroyed successfully.
May 13 02:06:23.752461 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lazy-loading 'resources' on Instance uuid 7a5cc9f0-2163-4891-a47e-5a5647066474 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:23.758552 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.796285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.799482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.823383 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.841136 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999679315000094 future=<Future at 0x705c6c27a7e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:23.842109 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999799017000214 future=<Future at 0x705c6c278f20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:23.907843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.908984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.912710 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.965712 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.965712 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:23.993158 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.093960 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.095558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.095558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.095558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.095558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.099824 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Terminating instance
May 13 02:06:24.101546 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.126395 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.185524 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.215375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.215519 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.216301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.216301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.216301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:24.216301 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state rescued and task_state unrescuing.
May 13 02:06:24.216301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.222706 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.227971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.228609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.228609 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:24.228731 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:24.230256 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.230256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Acquiring lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.230473 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.231411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.232146 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] No waiting events found dispatching network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:24.232668 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-unplugged-ef65e23b-b93f-4302-b817-cde4b9f86590 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:24.233718 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.244952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.244952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.246839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.251462 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:24.274075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e34ce90-e29b-4e6f-abf1-274705ea2c2a req-287fdc7e-5be8-45dc-a8de-5439ac331ab0 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:24.277461 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-232440299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-232440299',id=15,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOy3A5+aVu9S79GTyXJEOUqunbCfaZAL/jWVz7yUoBiJVbl6pb1pYNbDlfH/uNgNH8f76cG5+evJqYmGaCbkJQnaNamVcTqtUY2FHFisUsEKGVmXJOzLeUxQlfIHAd41Q==',key_name='tempest-keypair-1930142888',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3417bbe722944360a9197829e22c0cf0',ramdisk_id='',reservation_id='r-vxt69imj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2007551033',owner_user_name='tempest-TaggedAttachmentsTest-2007551033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ebfe9f4cab0466b93295e0e3b02ab7b',uuid=7a5cc9f0-2163-4891-a47e-5a5647066474,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:24.277918 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converting VIF {"id": "ef65e23b-b93f-4302-b817-cde4b9f86590", "address": "fa:16:3e:7e:07:a8", "network": {"id": "2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1582033883-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3417bbe722944360a9197829e22c0cf0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef65e23b-b9", "ovs_interfaceid": "ef65e23b-b93f-4302-b817-cde4b9f86590", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:24.279217 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:24.279217 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:24.280479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.280570 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef65e23b-b9, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:24.285597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.286515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:24.298323 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.305804 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.305804 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a607ac54-8fc0-4c06-8df3-38b27f46b2ad) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:24.309730 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.310630 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:24.318114 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.401383 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.406142 np0000000663 nova-compute[98103]: INFO os_vif [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:07:a8,bridge_name='br-int',has_traffic_filtering=True,id=ef65e23b-b93f-4302-b817-cde4b9f86590,network=Network(2a8d2a35-1163-4a0a-89b9-d8e2cf7ac42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef65e23b-b9')
May 13 02:06:24.406142 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Deleting instance files /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474_del
May 13 02:06:24.410167 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Deletion of /opt/stack/data/nova/instances/7a5cc9f0-2163-4891-a47e-5a5647066474_del complete
May 13 02:06:24.413194 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.538519 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.551187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.587656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.591240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.598337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.598337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.617501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:24.626498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.655870 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.685516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.735390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:24.779188 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.995s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.780871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:06:24.795461 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ec79b23-ad62-4b4e-8dc9-7eec8ac50612 req-04b2a50a-6ad9-4718-b65a-8bb8f228a792 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.795461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ec79b23-ad62-4b4e-8dc9-7eec8ac50612 req-04b2a50a-6ad9-4718-b65a-8bb8f228a792 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.795461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ec79b23-ad62-4b4e-8dc9-7eec8ac50612 req-04b2a50a-6ad9-4718-b65a-8bb8f228a792 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.795461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ec79b23-ad62-4b4e-8dc9-7eec8ac50612 req-04b2a50a-6ad9-4718-b65a-8bb8f228a792 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.795461 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ec79b23-ad62-4b4e-8dc9-7eec8ac50612 req-04b2a50a-6ad9-4718-b65a-8bb8f228a792 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:24.908049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dfd483bc-857c-47e9-92f9-56dfcfa0b226 req-128ed915-16b9-44f3-97b5-6aef0e12a630 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:24.909186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfd483bc-857c-47e9-92f9-56dfcfa0b226 req-128ed915-16b9-44f3-97b5-6aef0e12a630 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:24.909186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfd483bc-857c-47e9-92f9-56dfcfa0b226 req-128ed915-16b9-44f3-97b5-6aef0e12a630 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:24.909412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfd483bc-857c-47e9-92f9-56dfcfa0b226 req-128ed915-16b9-44f3-97b5-6aef0e12a630 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:24.909412 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dfd483bc-857c-47e9-92f9-56dfcfa0b226 req-128ed915-16b9-44f3-97b5-6aef0e12a630 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:24.930199 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Took 2.16 seconds to destroy the instance on the hypervisor.
May 13 02:06:24.935551 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:24.938034 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:24.938034 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:24.938034 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:24.993036 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.003607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.034693 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999600085999873 future=<Future at 0x705c487cb710 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:25.047261 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Instance destroyed successfully.
May 13 02:06:25.048939 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'resources' on Instance uuid 73e6d52d-6b8e-4ddc-926a-19f2df275829 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:25.189501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.197621 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.236545 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 07452882-6f7c-42c9-a561-800356006fcc due to new event <LifecycleEvent: 1778637985.2362123, 07452882-6f7c-42c9-a561-800356006fcc => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:06:25.236703 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637985.2362123, 07452882-6f7c-42c9-a561-800356006fcc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:25.236844 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Resumed (Lifecycle Event)
May 13 02:06:25.238003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.244216 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f7df7be2-d901-4825-afa0-67585adaa2e1 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:25.255389 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:25.291914 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:06:25.291914 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:06:25.292297 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:25.292592 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:25.373992 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.379676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.543548 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33425a40c04d488bba6393ace2394be5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeca98c5180647b2910bdd1f13ac4196', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:06:25.560831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1717430461',display_name='tempest-AttachVolumeNegativeTest-server-1717430461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-1717430461',id=18,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJn2GA2Om/OV7HC24qBHbaBBtfJsvkziONYkVqM4iryc0MIlYQlVfw2N20fk3gZZN+kwkINodevjG9/PjkHqrK7jkJBvDweAaornm+bR3Wrl8HQ+H0uh3Rk4EaVtJAK7AQ==',key_name='tempest-keypair-2140312991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:24Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-oerrrty3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=73e6d52d-6b8e-4ddc-926a-19f2df275829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:25.560831 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "49e85908-ceca-44ba-aa78-0f48bfd93126", "address": "fa:16:3e:93:58:8b", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49e85908-ce", "ovs_interfaceid": "49e85908-ceca-44ba-aa78-0f48bfd93126", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:25.562161 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:25.562161 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:25.566523 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.567179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49e85908-ce, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:25.568235 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.569962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:25.569962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.572421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.572421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d32bffa-653c-4c41-ae11-2cbfc1406e03) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:25.572421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.572421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:25.573206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.579173 np0000000663 nova-compute[98103]: INFO os_vif [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:58:8b,bridge_name='br-int',has_traffic_filtering=True,id=49e85908-ceca-44ba-aa78-0f48bfd93126,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49e85908-ce')
May 13 02:06:25.579173 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Deleting instance files /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829_del
May 13 02:06:25.580394 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Deletion of /opt/stack/data/nova/instances/73e6d52d-6b8e-4ddc-926a-19f2df275829_del complete
May 13 02:06:25.743654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:25.751117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:25.797983 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:06:25.876387 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:25.909664 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:26.089196 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Took 1.47 seconds to destroy the instance on the hypervisor.
May 13 02:06:26.089876 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:26.090250 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:26.090250 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:26.090458 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:26.215034 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:26.242539 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:26.255022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:26.256728 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637986.2562163, 07452882-6f7c-42c9-a561-800356006fcc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:26.257349 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Started (Lifecycle Event)
May 13 02:06:26.278001 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:26.306882 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No event matching network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 in dict_keys([('network-vif-plugged', '7e905afd-8d48-4a1d-a477-afb65fc61d17'), ('network-vif-plugged', '940bccd5-2181-49f7-8df6-d4778e88d08c'), ('network-vif-plugged', '0787a79e-aabd-474f-9a4b-f9578c22c59b'), ('network-vif-plugged', '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 for instance with vm_state building and task_state spawning.
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state active and task_state deleting.
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received unexpected event network-vif-plugged-301f181e-9efe-400b-afda-57ad52597154 for instance with vm_state active and task_state deleting.
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.406885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.409291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.409291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No event matching network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 in dict_keys([('network-vif-plugged', '940bccd5-2181-49f7-8df6-d4778e88d08c'), ('network-vif-plugged', '0787a79e-aabd-474f-9a4b-f9578c22c59b'), ('network-vif-plugged', '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:06:26.409586 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 for instance with vm_state building and task_state spawning.
May 13 02:06:26.409586 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.409872 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.409957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.410250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.410475 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d5f3fc9-be1a-45a6-84fc-f79d0ce35040 req-e33a977f-1bf6-4a4e-8866-8116516e7f94 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:26.497164 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:26.735761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.736676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.736974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.737767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.737767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.739742 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Terminating instance
May 13 02:06:26.764767 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:26.768964 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:26.817405 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Booting with volume c84d870e-7c67-46ef-b733-6926795384a7 at /dev/vda
May 13 02:06:26.885148 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:26.907177 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:26.913951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.914471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.914471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.914571 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.914799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No event matching network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f in dict_keys([('network-vif-plugged', '0787a79e-aabd-474f-9a4b-f9578c22c59b'), ('network-vif-plugged', '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:06:26.914799 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f for instance with vm_state building and task_state spawning.
May 13 02:06:26.914949 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.914994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.915110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.915385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.915845 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:26.916548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.916728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.917249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.917413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.917515 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No event matching network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b in dict_keys([('network-vif-plugged', '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:06:26.917610 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-0787a79e-aabd-474f-9a4b-f9578c22c59b for instance with vm_state building and task_state spawning.
May 13 02:06:26.917706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.918184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.918375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.918454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.918566 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] No waiting events found dispatching network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:26.918645 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:26.918746 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:26.918866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Acquiring lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:26.919191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:26.919511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:26.919822 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] No waiting events found dispatching network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:26.920008 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c83c7706-71d3-4589-b540-20e8d6a3d8d4 req-1ed0d7f3-a14f-45a3-a6a7-1457bb139874 service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-unplugged-49e85908-ceca-44ba-aa78-0f48bfd93126 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:26.941879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:26.994830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:26.995154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:26.999798 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Took 2.06 seconds to deallocate network for instance.
May 13 02:06:27.006819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:27.008619 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::fc16:3eff:fe7f:a02b', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c'] 
May 13 02:06:27.008770 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:27.008893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:27.011937 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:27.012312 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating existing volume attachment record: 419c2f1b-f7b6-4387-bd0f-872ab1c935e7 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:06:27.025350 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:27.025465 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing instance network info cache due to event network-changed-4f211add-0e46-4ffd-a752-e55248d89c33. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:27.025667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Acquiring lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:27.030165 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Acquired lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:27.030165 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Refreshing network info cache for port 4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:27.206225 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Successfully created port: 86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:06:27.251212 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:27.271805 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07452882-6f7c-42c9-a561-800356006fcc] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 02:06:27.272071 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637987.271911, 71da4951-934a-4b63-b242-61f4e395eaf8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:27.272561 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] VM Started (Lifecycle Event)
May 13 02:06:27.273792 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:27.297633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:27.360965 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:27.413107 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:27.421690 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:27.524475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:27.524475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:27.532579 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:27.541551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:27.541761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:27.642979 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Instance destroyed successfully.
May 13 02:06:27.645813 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid 07452882-6f7c-42c9-a561-800356006fcc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:27.785354 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:27.788413 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637987.7881188, 71da4951-934a-4b63-b242-61f4e395eaf8 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:27.791162 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] VM Paused (Lifecycle Event)
May 13 02:06:27.835827 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Successfully updated port: 86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:06:27.865961 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Took 1.78 seconds to deallocate network for instance.
May 13 02:06:27.914497 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:28.054806 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:28.126000 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updated VIF entry in instance network info cache for port 4f211add-0e46-4ffd-a752-e55248d89c33. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:28.126243 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating instance_info_cache with network_info: [{"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:28.148779 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1370512412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1370512412',id=21,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:17Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-g06r6y4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:25Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=07452882-6f7c-42c9-a561-800356006fcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:28.149337 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "301f181e-9efe-400b-afda-57ad52597154", "address": "fa:16:3e:7f:a0:2b", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap301f181e-9e", "ovs_interfaceid": "301f181e-9efe-400b-afda-57ad52597154", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:28.150305 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:28.150614 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:28.152530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:28.152628 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap301f181e-9e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:28.159128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:28.160660 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:28.162079 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:28.162400 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e87f5a7-1165-4561-b960-967a7a7afc4a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:28.165828 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:28.167537 np0000000663 nova-compute[98103]: INFO os_vif [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:a0:2b,bridge_name='br-int',has_traffic_filtering=True,id=301f181e-9efe-400b-afda-57ad52597154,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap301f181e-9e')
May 13 02:06:28.168720 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:28.169107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:28.169284 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:28.169762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:28.170147 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:28.170287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:28.216431 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:28.216942 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:28.216942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '35')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:28.218305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b', '36')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:28.219715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6af4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:28.219887 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:28.220246 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flush multipath device 33000000004d05078 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:28.281825 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:28.282023 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:28.284667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:28.295499 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:28.297520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:28.338191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:28.338301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:28.338459 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:28.340965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:28.377242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.388806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:28.388957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:28.390411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:28.402541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:28.405124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:28.416719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.461875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.40.100,3260]
May 13 02:06:28.461875 np0000000663 nova-compute[98103]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.40.100,3260] successful.
May 13 02:06:28.461875 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.486574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.499877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.534032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.50.100,3260]
May 13 02:06:28.534032 np0000000663 nova-compute[98103]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-872d3e36-4ce5-4b87-8ca7-ab80bba5928b, portal: 192.168.50.100,3260] successful.
May 13 02:06:28.534032 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.563373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:28.563828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:28.564032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== disconnect_volume: return (394ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:28.564254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:28.564657 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Deleting instance files /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc_del
May 13 02:06:28.565211 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Deletion of /opt/stack/data/nova/instances/07452882-6f7c-42c9-a561-800356006fcc_del complete
May 13 02:06:28.628061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Releasing lock "refresh_cache-2d1c8212-2a2a-4392-89cb-410a0a987de8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:28.628260 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.628395 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing instance network info cache due to event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:28.628533 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Acquiring lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:28.628605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Acquired lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:28.628707 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:28.699812 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.701503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.701503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:28.702832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:28.702832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No event matching network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c in dict_keys([('network-vif-plugged', '41d2df2c-3a8f-44b4-a523-cd5a3ffbe203')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:06:28.702832 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-940bccd5-2181-49f7-8df6-d4778e88d08c for instance with vm_state building and task_state spawning.
May 13 02:06:28.702832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.702952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.703446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:28.703446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:28.703446 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Processing event network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:28.703446 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.703569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.703690 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:28.705624 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:28.706952 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:28.706952 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:28.707083 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 for instance with vm_state building and task_state spawning.
May 13 02:06:28.707349 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.707349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.707418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:28.707543 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:28.707662 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:28.707781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:28.707913 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:28.708052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Acquiring lock "07452882-6f7c-42c9-a561-800356006fcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:28.708186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:28.708310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] Lock "07452882-6f7c-42c9-a561-800356006fcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:28.708422 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] No waiting events found dispatching network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:28.708534 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-94c6135c-9348-4603-b48a-d5995c4d5785 req-b3aa3a32-7b4b-4235-a242-b039cae77480 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-unplugged-301f181e-9efe-400b-afda-57ad52597154 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:28.713229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:28.716653 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance spawned successfully.
May 13 02:06:28.717792 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:28.785077 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:28.800552 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:28.800950 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999819204000005 future=<Future at 0x705c881c6450 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.801158 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637988.800981, 71da4951-934a-4b63-b242-61f4e395eaf8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:28.801330 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] VM Resumed (Lifecycle Event)
May 13 02:06:28.907223 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:28.919235 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00043853399984072894 future=<Future at 0x705c48689b80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.919616 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Emitting event <LifecycleEvent: 1778637973.9186764, df1e125d-18cb-4cef-bfc7-9612eb69b3e1 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:28.919748 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.919898 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] VM Stopped (Lifecycle Event)
May 13 02:06:28.920952 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.919827833999989 future=<Future at 0x705c6c27a7e0 state=cancelled>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.923872 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.919202923000057 future=<Future at 0x705c6c27a7e0 state=cancelled>) was cancelled while queued, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.923872 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.923872 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.919515814000079 future=<Future at 0x705c6c278f20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.923872 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.919414135000125 future=<Future at 0x705c6c278f20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:28.980711 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d83eae74-ef63-4ea1-baf8-8ea8bcad1805 req-f1f9c0f3-220b-471f-83c3-f04df8598edc service nova] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Received event network-vif-deleted-49e85908-ceca-44ba-aa78-0f48bfd93126 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:29.060721 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:29.062890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.521s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:29.076792 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Took 1.83 seconds to destroy the instance on the hypervisor.
May 13 02:06:29.080123 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:29.081209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:29.081209 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:29.081209 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:29.115305 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-changed-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:29.115469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Refreshing instance network info cache due to event network-changed-86a2acdd-98ba-4f77-83d6-b7f93793b27f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:29.115606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:29.131297 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:29.151143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:06:29.152581 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:29.155452 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Creating image(s)
May 13 02:06:29.155862 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:06:29.156071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Ensure instance console log exists: /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:29.158378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:29.158597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:29.158770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:29.224689 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.224689 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.225018 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.225274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.225430 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.225713 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:29.235859 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:29.291780 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:29.293759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.771s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:29.296864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.919s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:29.304662 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:29.313372 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:29.372599 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Deleted allocations for instance 7a5cc9f0-2163-4891-a47e-5a5647066474
May 13 02:06:29.422960 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: df1e125d-18cb-4cef-bfc7-9612eb69b3e1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:29.634448 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:29.732584 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Took 39.80 seconds to spawn the instance on the hypervisor.
May 13 02:06:29.737073 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:29.798022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:29.798328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance network_info: |[{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:06:29.799795 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:29.799795 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Refreshing network info cache for port 86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:29.801511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start _get_guest_xml network_info=[{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '81d1e9b6-0f42-49d5-95ee-01273edb45c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'serial': 'c84d870e-7c67-46ef-b733-6926795384a7'}, 'attachment_id': '419c2f1b-f7b6-4387-bd0f-872ab1c935e7', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:29.818868 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:29.818868 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:29.820509 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-429451115', uuid='81d1e9b6-0f42-49d5-95ee-01273edb45c7'), owner=OwnerMeta(userid='33425a40c04d488bba6393ace2394be5', username='tempest-ServerActionsTestOtherA-1936571963-project-member', projectid='eeca98c5180647b2910bdd1f13ac4196', projectname='tempest-ServerActionsTestOtherA-1936571963'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778637989.8195817) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:29.822715 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:29.823563 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:29.825422 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:29.825646 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:29.828654 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:29.829254 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:29.830110 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:29.842963 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updated VIF entry in instance network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:29.843441 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating instance_info_cache with network_info: [{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:29.848287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:29.848805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:29.849054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:29.849349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:29.849529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:29.873441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:29.874870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:29.888621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.014s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:29.888886 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:29.889442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.017s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:29.889776 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:29.907233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:29.907233 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:29.908125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:29.908125 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:29.921179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7] added
May 13 02:06:29.921179 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:29.921179 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:29.921179 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:29.921179 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:29.921179 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:29.921179 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:29.921724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:29.921724 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:29.921724 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:29.923865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7] added
May 13 02:06:29.923865 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:29.923865 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:29.923865 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:29.923865 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:29.923865 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:29.923865 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:29.924190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:29.924289 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0345(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:29.924480 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:30.130741 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:30.138509 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:30.138709 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:30.177967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:30.178285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:30.178528 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Attaching volume be0189f1-ad88-4219-b716-eb9a42301d89 to /dev/vdb
May 13 02:06:30.214865 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:30.226247 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:30.246320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:30.258109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:30.272321 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Took 54.78 seconds to build instance.
May 13 02:06:30.283565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:30.283887 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:30.293484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:30.294933 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe9c:3911', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c'] 
May 13 02:06:30.295048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:30.295159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:30.295387 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:30.295619 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating existing volume attachment record: 73687f83-9bb7-4a3e-9896-67e14f46723a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:06:30.309343 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:30.346344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Releasing lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:30.346520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:30.346726 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:30.347047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:30.347203 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:30.347458 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:30.347657 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received unexpected event network-vif-plugged-f226364b-9343-4b55-a3d8-f2efb251fdff for instance with vm_state building and task_state spawning.
May 13 02:06:30.347778 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9caedc3-d9be-4342-9d6a-4b00d7a16269 req-a65878b7-cd0f-4427-a43b-02756c03c3e2 service nova] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Received event network-vif-deleted-ef65e23b-b93f-4302-b817-cde4b9f86590 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:30.394059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-267ac917-aba0-40cf-8991-d3d8a0073133 tempest-TaggedAttachmentsTest-2007551033 tempest-TaggedAttachmentsTest-2007551033-project-member] Lock "7a5cc9f0-2163-4891-a47e-5a5647066474" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.149s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:30.633470 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Took 1.55 seconds to deallocate network for instance.
May 13 02:06:30.641185 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:30.691227 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:30.773794 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4562f779-eb86-4f21-841c-ab90025c4c12 req-34acca2f-4e7b-45fd-8fee-7cc55ce2fc39 service nova] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Received event network-vif-deleted-301f181e-9efe-400b-afda-57ad52597154 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:30.777197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8b706817-230f-4edb-9258-a7f721d23f93 tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.292s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:30.833555 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updated VIF entry in instance network info cache for port 86a2acdd-98ba-4f77-83d6-b7f93793b27f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:30.833555 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:30.849642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:30.850012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:30.850204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:30.922168 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:30.924923 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:30.937107 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:30.937107 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:30.948128 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:30.948128 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:30.956033 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:30.963912 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.984951 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.985426 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.989032 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:30.989454 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:31.070413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260]
May 13 02:06:31.070413 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260] successful.
May 13 02:06:31.070413 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:31.075213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260]
May 13 02:06:31.075213 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260] successful.
May 13 02:06:31.075213 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:31.087580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:31.095720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.115634 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:31.116522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:31.116522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:31.117647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('14', '-', '-', 0) found on session 52 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:31.117826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.124475 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:31.124945 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:31.125343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.237s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:31.125343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:31.126980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('13', '-', '-', 0) found on session 51 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:31.127234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:31.164228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.853s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:31.164228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 52 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:31.164228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:31.164228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 51 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:31.164228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:31.227908 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Deleted allocations for instance 73e6d52d-6b8e-4ddc-926a-19f2df275829
May 13 02:06:31.236248 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Took 0.60 seconds to detach 1 volumes for instance.
May 13 02:06:31.238351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Deleting volume: 872d3e36-4ce5-4b87-8ca7-ab80bba5928b {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:06:31.337078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fe177bf-eefa-472b-946b-9ba151079553 req-9dd1422c-2c6e-4923-ae3c-48c6f9e8456f service nova] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:31.823172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:31.823172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:31.877449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:31.945453 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-changed-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:31.945800 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing instance network info cache due to event network-changed-427e00b4-93dd-4fa7-9124-1214b806e8d0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:31.945800 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] Acquiring lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:31.945894 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] Acquired lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:31.946043 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Refreshing network info cache for port 427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:32.244769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2fa847a8-6e50-4545-b4e8-1be0543c7803 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "73e6d52d-6b8e-4ddc-926a-19f2df275829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.150s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:32.449330 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:32.528862 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:32.529215 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:32.897845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found WWN 330000000ee111f48 for multipath device dm-8 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:32.901439 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:32.901878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '330000000ee111f48', 'path': '/dev/dm-8', 'multipath_id': '330000000ee111f48'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:32.902133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee111f48', 'path': '/dev/dm-8', 'multipath_id': '330000000ee111f48'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:32.903072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.053s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:32.903532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:32.906391 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:32.923482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:32.924109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:32.924989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:32.925232 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:32.926535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:32.926717 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:32.950633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:32.950633 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:32.959572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:32.959572 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:32.968737 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89] added
May 13 02:06:32.968737 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:32.968737 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:32.968737 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:32.968737 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:32.968737 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:32.968737 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:32.969069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:32.969445 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:32.969719 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:32.975291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89] added
May 13 02:06:32.975291 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:32.975291 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:32.975291 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:32.975291 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:32.975291 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:32.975291 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:32.980185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:32.980185 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0517(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:32.980185 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:33.032495 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:33.093515 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updated VIF entry in instance network info cache for port 427e00b4-93dd-4fa7-9124-1214b806e8d0. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:33.093926 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:33.163533 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.418490 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:33.418656 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:33.423308 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:33.423308 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'pci_devices' on Instance uuid 81d1e9b6-0f42-49d5-95ee-01273edb45c7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:33.543545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.721s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:33.599199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47e451fa-31cc-4cd8-b8d4-de023afa01f2 req-5dd7a9be-474a-489b-aa53-4d4344623918 service nova] Releasing lock "refresh_cache-71da4951-934a-4b63-b242-61f4e395eaf8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:33.633954 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Deleted allocations for instance 07452882-6f7c-42c9-a561-800356006fcc
May 13 02:06:33.929609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <uuid>81d1e9b6-0f42-49d5-95ee-01273edb45c7</uuid>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <name>instance-0000001a</name>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherA-server-429451115</nova:name>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:29</nova:creationTime>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:user uuid="33425a40c04d488bba6393ace2394be5">tempest-ServerActionsTestOtherA-1936571963-project-member</nova:user>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:project uuid="eeca98c5180647b2910bdd1f13ac4196">tempest-ServerActionsTestOtherA-1936571963</nova:project>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         <nova:port uuid="86a2acdd-98ba-4f77-83d6-b7f93793b27f">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="serial">81d1e9b6-0f42-49d5-95ee-01273edb45c7</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="uuid">81d1e9b6-0f42-49d5-95ee-01273edb45c7</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <alias name="ua-c84d870e-7c67-46ef-b733-6926795384a7"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-8"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <serial>c84d870e-7c67-46ef-b733-6926795384a7</serial>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:fa:f1:84"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <target dev="tap86a2acdd-98"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/console.log" append="off"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:33.929609 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Preparing to wait for external event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:33.931534 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:33.932515 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:33.932515 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:33.933369 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.934014 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:33.935076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:33.936683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.937218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2671660-6da7-5b13-acb9-26b7ec603e6c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:33.938566 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.938758 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:33.939056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.944268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.944607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86a2acdd-98, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:33.945313 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86a2acdd-98, col_values=(('qos', UUID('ef95aa18-a30c-4d53-b373-99a6b328f99d')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:33.945407 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86a2acdd-98, col_values=(('external_ids', {'iface-id': '86a2acdd-98ba-4f77-83d6-b7f93793b27f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:f1:84', 'vm-uuid': '81d1e9b6-0f42-49d5-95ee-01273edb45c7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:33.946451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.949156 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:33.955734 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:33.956863 np0000000663 nova-compute[98103]: INFO os_vif [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98')
May 13 02:06:33.970209 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:33.978301 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:33.988904 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:33.988904 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:34.000210 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:34.000210 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.009777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.019291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.031763 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.044436 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:34.095975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.50.100,3260]
May 13 02:06:34.095975 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.50.100,3260] successful.
May 13 02:06:34.095975 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.105318 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.40.100,3260]
May 13 02:06:34.105318 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.40.100,3260] successful.
May 13 02:06:34.105318 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.116304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.123881 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.148136 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:34.148859 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:34.148859 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:34.151736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('17', '-', '-', 0) found on session 53 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:34.152194 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:34.162441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:34.163474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.238s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:34.163474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:34.164362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('18', '-', '-', 0) found on session 54 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:34.164362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:34.180053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 53 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:34.181151 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:34.198805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 54 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:34.198805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:34.646581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2680bef-08e1-442c-8b45-7797cf800825 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "07452882-6f7c-42c9-a561-800356006fcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.910s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:34.925379 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:35.254522 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:35.407560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:35.481953 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:35.485106 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:35.485399 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:fa:f1:84, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:35.486196 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Using config drive
May 13 02:06:35.946748 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 33000000030bd621c for multipath device dm-11 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:35.947081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:35.947587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (5096ms) {'type': 'block', 'scsi_wwn': '33000000030bd621c', 'path': '/dev/dm-11', 'multipath_id': '33000000030bd621c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:35.947775 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000030bd621c', 'path': '/dev/dm-11', 'multipath_id': '33000000030bd621c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:35.954197 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:35.992636 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:36.187948 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Creating config drive at /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config
May 13 02:06:36.194697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpidd38soq {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:36.263662 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpidd38soq" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:36.459430 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Attempting to attach volume be0189f1-ad88-4219-b716-eb9a42301d89 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:06:36.461522 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:36.461522 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:06:36.472865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:36.473150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:36.473565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:36.473636 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:36.473765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:36.488196 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Terminating instance
May 13 02:06:36.644446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:36.644657 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:36.899196 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:36.929810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:36.935104 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:36.996319 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:37.020843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.023801 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.063809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.072438 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.081475 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.088815 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.148392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:06:37.184545 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d3b5a9dd-8d9a-44f3-a2fd-d610d9b7a3c7 req-757823f4-1531-425e-9076-039da8acadb8 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:37.185373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3b5a9dd-8d9a-44f3-a2fd-d610d9b7a3c7 req-757823f4-1531-425e-9076-039da8acadb8 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:37.187964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3b5a9dd-8d9a-44f3-a2fd-d610d9b7a3c7 req-757823f4-1531-425e-9076-039da8acadb8 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:37.188368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d3b5a9dd-8d9a-44f3-a2fd-d610d9b7a3c7 req-757823f4-1531-425e-9076-039da8acadb8 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:37.188481 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d3b5a9dd-8d9a-44f3-a2fd-d610d9b7a3c7 req-757823f4-1531-425e-9076-039da8acadb8 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Processing event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:37.250749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.261195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.324706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.339479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.362543 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999600536999878 future=<Future at 0x705c6c62be90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:37.364746 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Instance destroyed successfully.
May 13 02:06:37.366915 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:37.734196 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:37.734414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:37.737887 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:37.738156 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Claim successful on node np0000000663
May 13 02:06:37.872186 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-19115054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-19115054',id=17,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:23Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-yjou0vem',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:32Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=e53ce1bc-0ccb-45b9-a44a-0b1313f84af7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:37.872413 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "address": "fa:16:3e:9c:39:11", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapee18a68a-0d", "ovs_interfaceid": "ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:37.874110 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:37.874110 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:37.875157 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.875440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee18a68a-0d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:37.890197 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.891721 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:37.893686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.893825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04177165-879e-49ff-828b-102b9ecd41e0) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:37.894342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.895522 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:37.895675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:37.899018 np0000000663 nova-compute[98103]: INFO os_vif [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:39:11,bridge_name='br-int',has_traffic_filtering=True,id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee18a68a-0d')
May 13 02:06:37.899260 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Deleting instance files /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7_del
May 13 02:06:37.899964 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Deletion of /opt/stack/data/nova/instances/e53ce1bc-0ccb-45b9-a44a-0b1313f84af7_del complete
May 13 02:06:38.031020 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637998.030573, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:38.031465 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Started (Lifecycle Event)
May 13 02:06:38.032557 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:38.038154 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:38.043057 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance spawned successfully.
May 13 02:06:38.043574 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:38.300333 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:38.300561 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:38.300721 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:38.300898 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:71:1d:0d, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:38.410870 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:06:38.410870 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:38.411656 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:38.411656 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:38.412031 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:38.521352 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:38.534675 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:38.539509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.560177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:38.841726 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004031349999422673 future=<Future at 0x705c6c278f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:38.841873 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:38.841988 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.1921732389998851 future=<Future at 0x705c487cb710 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:38.842104 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.1920531859998391 future=<Future at 0x705c487cb710 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:38.842985 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778637983.8412251, 7a5cc9f0-2163-4891-a47e-5a5647066474 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:38.843182 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] VM Stopped (Lifecycle Event)
May 13 02:06:39.015400 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9299297f-68fc-43ea-b421-19eae77f3b51 req-9568f3f5-db56-4f4e-9faa-ca66eb368adb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-deleted-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:39.015614 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-9299297f-68fc-43ea-b421-19eae77f3b51 req-9568f3f5-db56-4f4e-9faa-ca66eb368adb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Neutron deleted interface ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332; detaching it from the instance and deleting it from the info cache
May 13 02:06:39.015852 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9299297f-68fc-43ea-b421-19eae77f3b51 req-9568f3f5-db56-4f4e-9faa-ca66eb368adb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:39.045490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:39.045490 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637999.0448453, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:39.045490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Paused (Lifecycle Event)
May 13 02:06:39.074024 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Took 9.92 seconds to spawn the instance on the hypervisor.
May 13 02:06:39.077421 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:39.281378 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:39.282467 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:39.282467 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:39.282467 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:39.283330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:39.283622 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received unexpected event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with vm_state active and task_state None.
May 13 02:06:39.284184 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:39.284516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:39.284709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:39.284849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:39.285012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] No waiting events found dispatching network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:39.285182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:39.285334 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:39.285495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Acquiring lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:39.285658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:39.285807 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:39.285961 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] No waiting events found dispatching network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:39.286876 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c79c5de8-35fc-49b3-b372-ed91e814b8c2 req-31709338-32a1-4f08-bd7b-45f34dd0b78a service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Received event network-vif-unplugged-ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:39.351662 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 7a5cc9f0-2163-4891-a47e-5a5647066474] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:39.437955 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:39.522813 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9299297f-68fc-43ea-b421-19eae77f3b51 req-9568f3f5-db56-4f4e-9faa-ca66eb368adb service nova] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Detach interface failed, port_id=ee18a68a-0da9-4e2d-aa2e-cd6d04bd7332, reason: Instance e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:06:39.522813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:39.522913 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:39.549864 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:39.554666 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778637999.55433, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:39.555445 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Resumed (Lifecycle Event)
May 13 02:06:39.597502 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Took 17.95 seconds to build instance.
May 13 02:06:39.647651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:39.647845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:39.878765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0926adb1-a84c-478a-a558-926c9e256e1c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.700s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:39.939983 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Took 1.53 seconds to deallocate network for instance.
May 13 02:06:40.026507 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:40.040187 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.005954395000117074 future=<Future at 0x705c487cb710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:40.042199 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1778637985.0340838, 73e6d52d-6b8e-4ddc-926a-19f2df275829 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:40.042199 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:40.042444 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] VM Stopped (Lifecycle Event)
May 13 02:06:40.043399 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.757383339999933 future=<Future at 0x705c881c6450 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:40.043590 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.757213845000024 future=<Future at 0x705c881c6450 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:40.069320 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:40.072146 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:40.098581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.470s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:40.151635 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:40.266401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:40.448684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:40.542512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.808s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:40.543252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.094s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:40.543431 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:06:40.548442 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5209492a-c014-43a9-8618-520e1d19aaab None None] [instance: 73e6d52d-6b8e-4ddc-926a-19f2df275829] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:41.056579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:06:41.060173 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:06:41.060173 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:41.060173 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:41.159892 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff4dd8b153c4ae98a37ba022bb538c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9a7e74db544084a4907abd0f241e8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:06:41.161382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:41.262073 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:41.262416 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:41.558034 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:06:41.768695 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:41.990361 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Successfully created port: 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:06:42.061291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:06:42.166548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-changed-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:42.166751 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing instance network info cache due to event network-changed-89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:42.171118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] Acquiring lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:42.171118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] Acquired lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:42.171118 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Refreshing network info cache for port 89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:42.294152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.748s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:42.347034 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:42.347034 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:42.347296 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Attaching volume be0189f1-ad88-4219-b716-eb9a42301d89 to /dev/vdb
May 13 02:06:42.380174 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Deleted allocations for instance e53ce1bc-0ccb-45b9-a44a-0b1313f84af7
May 13 02:06:42.437622 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:42.455711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:42.484456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:42.537940 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:42.538657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:42.553086 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:42.556697 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe41:4e0e', 'fe80::a036:7dff:fee0:88dc', 'fe80::fc16:3eff:fe25:168e', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe78:d035', 'fe80::d4b4:74ff:fe06:f207', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c', 'fe80::fc16:3eff:fefa:f184'] 
May 13 02:06:42.556939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:42.557123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:42.557787 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:42.557787 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating existing volume attachment record: 25b6b569-4f94-4a01-8840-7a197ab00d77 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:06:42.675683 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:42.840940 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Successfully updated port: 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:06:42.897744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:42.944988 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-changed-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:42.945151 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Refreshing instance network info cache due to event network-changed-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:42.945470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] Acquiring lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:42.945542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] Acquired lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:42.946672 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Refreshing network info cache for port 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:43.079172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:06:43.080615 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:43.080874 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Creating image(s)
May 13 02:06:43.083553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:43.083553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:43.083553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:43.083553 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:43.087287 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:43.090697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:43.145384 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:43.161664 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:43.162157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:43.162386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:43.166041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:43.166336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:43.185685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:43.186270 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:43.188145 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:43.188145 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:43.188553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:43.189301 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:43.193499 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:43.194747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:43.196830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:43.200877 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:43.212272 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:43.212272 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:43.219642 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:06:43.223616 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:06:43.223616 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:43.225662 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:43.268283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:43.271285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.292707 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.293462 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:43.293800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.107s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:43.293800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:43.295647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('18', '0', '0', 0) found on session 54 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:43.295647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.303740 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:43.304288 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:43.304288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.116s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:43.304712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:06:43.305499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('17', '0', '0', 0) found on session 53 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:06:43.305724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:06:43.318385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 54 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:43.318591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:43.321378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 53 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:06:43.321625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:06:43.343006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:43.352294 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:43.352294 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:43.410660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cbebcda-05ee-44c6-a218-5ec2f03ee0d5 tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "e53ce1bc-0ccb-45b9-a44a-0b1313f84af7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.937s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:43.430617 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updated VIF entry in instance network info cache for port 89932177-53f0-4903-bef2-895d215d7444. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:43.430996 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [{"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:43.445641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk 1073741824" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:43.446022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:43.446367 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:43.471498 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:43.558325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:43.558646 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:06:43.558837 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:43.623291 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:43.655929 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:43.663175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:43.664065 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Cannot resize image /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:06:43.665376 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:06:43.665376 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Ensure instance console log exists: /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:43.665376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:43.665487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:43.665600 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:43.801737 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0008576860000175657 future=<Future at 0x705c881c6450 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:43.802780 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778637988.8006933, 07452882-6f7c-42c9-a561-800356006fcc => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:43.802994 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:43.804316 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.557825432999834 future=<Future at 0x705c6c62be90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:43.804316 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.557715277999932 future=<Future at 0x705c6c62be90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:43.804316 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] VM Stopped (Lifecycle Event)
May 13 02:06:43.881687 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:43.936141 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c95f8650-fc56-4764-ad18-4ad0b923ea67 req-a177c325-9e94-4b29-a153-bffd17d64181 service nova] Releasing lock "refresh_cache-ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:44.189002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:06:44.192504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:44.192504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:44.192504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:44.192504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:44.192504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:44.196028 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Terminating instance
May 13 02:06:44.246125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-changed-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:44.246125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Refreshing instance network info cache due to event network-changed-86a2acdd-98ba-4f77-83d6-b7f93793b27f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:44.246125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:44.246125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:44.246125 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Refreshing network info cache for port 86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:44.258918 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Stashing vm_state: active {{(pid=98103) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 02:06:44.306332 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 07452882-6f7c-42c9-a561-800356006fcc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:44.384631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b35960e9-7bea-4cee-b0bf-4d136563a9bc req-c4723730-8503-445b-b12b-ffb2c0e87459 service nova] Releasing lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:44.385720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquired lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:44.386429 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:44.709433 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:44.729780 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:44.735631 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:44.750121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:44.766999 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:44.838114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:44.838557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:44.899333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:44.905896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:44.989337 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:45.065846 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999702468000123 future=<Future at 0x705c8017f110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:45.076634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Instance destroyed successfully.
May 13 02:06:45.077427 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid d8e796d1-f442-4a33-935b-863c6340bbca {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:45.147957 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:45.148851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:45.148956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:45.149337 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:45.149337 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:45.149337 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bef13f0f-7472-4db1-abfe-fe9cb69b4f31 req-4ed71c25-f9b7-4188-8d14-d46b5a575279 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:45.211179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 33000000030bd621c for multipath device dm-11 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:06:45.212347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:45.212660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (2049ms) {'type': 'block', 'scsi_wwn': '33000000030bd621c', 'path': '/dev/dm-11', 'multipath_id': '33000000030bd621c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:45.212824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000030bd621c', 'path': '/dev/dm-11', 'multipath_id': '33000000030bd621c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:06:45.215579 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:45.266936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.284752 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:45.345742 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:45.346008 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Claim successful on node np0000000663
May 13 02:06:45.486116 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating instance_info_cache with network_info: [{"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:45.542307 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:45.580402 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-210277000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-210277000',id=13,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:04:52Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-py4iqc2z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:00Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=d8e796d1-f442-4a33-935b-863c6340bbca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:45.580559 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "536a799f-3ef3-43a5-bc46-33adc66429e1", "address": "fa:16:3e:25:16:8e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap536a799f-3e", "ovs_interfaceid": "536a799f-3ef3-43a5-bc46-33adc66429e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:45.581079 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:45.581332 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:45.584054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.584350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap536a799f-3e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:45.585505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.586299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:45.586875 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.587846 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.588003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60cd4a88-b354-4d30-810d-a07fbe240f2c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:45.588464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.589023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:45.589468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:45.593673 np0000000663 nova-compute[98103]: INFO os_vif [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:16:8e,bridge_name='br-int',has_traffic_filtering=True,id=536a799f-3ef3-43a5-bc46-33adc66429e1,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap536a799f-3e')
May 13 02:06:45.597316 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:45.597644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:45.597814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:45.598216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:45.598583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd5e17c66-f6eb-498a-9579-05dc2395134e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:45.598936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:45.633548 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsi session list stdout=tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:45.635031 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '54')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:45.635031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '19')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:45.636616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e', '20')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:45.636851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c80176a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:45.637121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:45.639423 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Flush multipath device 33000000094b3b32e {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:45.671154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:45.700018 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updated VIF entry in instance network info cache for port 86a2acdd-98ba-4f77-83d6-b7f93793b27f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:45.700569 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:45.719915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Attempting to attach volume be0189f1-ad88-4219-b716-eb9a42301d89 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:06:45.721100 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:45.721100 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:06:45.730283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:45.792327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:45.792636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:45.794810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:45.810740 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:45.810740 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:45.821728 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:45.855358 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating resource usage from migration ce28afbb-8992-4d3e-9f4d-2ee7b398cfcd
May 13 02:06:45.871394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.40.100,3260]
May 13 02:06:45.871394 np0000000663 nova-compute[98103]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.40.100,3260] successful.
May 13 02:06:45.871394 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:45.908292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:45.921716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:45.979494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.50.100,3260]
May 13 02:06:45.979494 np0000000663 nova-compute[98103]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-d5e17c66-f6eb-498a-9579-05dc2395134e, portal: 192.168.50.100,3260] successful.
May 13 02:06:45.979494 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:45.985949 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Releasing lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:45.986307 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance network_info: |[{"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:06:45.989027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Start _get_guest_xml network_info=[{"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:45.991606 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:45.993331 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-483433836', uuid='41124908-2411-4160-b41a-ef09899a2b82'), owner=OwnerMeta(userid='0ff4dd8b153c4ae98a37ba022bb538c6', username='tempest-AttachVolumeNegativeTest-603660763-project-member', projectid='4b9a7e74db544084a4907abd0f241e8b', projectname='tempest-AttachVolumeNegativeTest-603660763'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638005.9928932) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:45.994708 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:45.995377 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:45.996763 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:45.997084 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:45.998448 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:45.999055 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:45.999536 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:46.000759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:46.000759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:46.000759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:46.000759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:46.001303 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:46.004121 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:46.004121 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:46.004121 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:46.004121 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:46.013914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:46.014183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:46.014344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] <== disconnect_volume: return (416ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:46.014472 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:46.014733 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Deleting instance files /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca_del
May 13 02:06:46.016021 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Deletion of /opt/stack/data/nova/instances/d8e796d1-f442-4a33-935b-863c6340bbca_del complete
May 13 02:06:46.021553 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-483433836',display_name='tempest-AttachVolumeNegativeTest-server-483433836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-483433836',id=27,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEs3Sg8xPmq4gdwB1H0CArifHNxheAZdeMJ5PDO9B/tI2v2iiiWL6LBQf9YslIZbYMCuJNs4lXfHfhKHPRoFuHE/sH8mPjO+7p3j2acoFftUaA1ElWLvQEwHV0pSGuMIQ==',key_name='tempest-keypair-2017501616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-r982nrcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=41124908-2411-4160-b41a-ef09899a2b82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:46.022037 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:46.022716 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:46.023500 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'pci_devices' on Instance uuid 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:46.206776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c73b2484-ca4d-4afe-9eeb-49bba0b09662 req-86e68429-8093-4456-8c02-6b503bf7c345 service nova] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:46.253129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.519655 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:46.519897 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:46.523928 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Took 1.81 seconds to destroy the instance on the hypervisor.
May 13 02:06:46.524421 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:46.525677 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:46.525677 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:46.525677 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:46.528962 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <uuid>41124908-2411-4160-b41a-ef09899a2b82</uuid>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <name>instance-0000001b</name>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeNegativeTest-server-483433836</nova:name>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:45</nova:creationTime>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:user uuid="0ff4dd8b153c4ae98a37ba022bb538c6">tempest-AttachVolumeNegativeTest-603660763-project-member</nova:user>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:project uuid="4b9a7e74db544084a4907abd0f241e8b">tempest-AttachVolumeNegativeTest-603660763</nova:project>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         <nova:port uuid="760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="serial">41124908-2411-4160-b41a-ef09899a2b82</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="uuid">41124908-2411-4160-b41a-ef09899a2b82</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.config"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:8e:35:28"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <target dev="tap760a1107-1c"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/console.log" append="off"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:46.528962 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Preparing to wait for external event network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-483433836',display_name='tempest-AttachVolumeNegativeTest-server-483433836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-483433836',id=27,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEs3Sg8xPmq4gdwB1H0CArifHNxheAZdeMJ5PDO9B/tI2v2iiiWL6LBQf9YslIZbYMCuJNs4lXfHfhKHPRoFuHE/sH8mPjO+7p3j2acoFftUaA1ElWLvQEwHV0pSGuMIQ==',key_name='tempest-keypair-2017501616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-r982nrcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=41124908-2411-4160-b41a-ef09899a2b82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.535486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ccc8d13-997a-59cb-987e-578d504478c1', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:46.539065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.539620 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:46.543417 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.543597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap760a1107-1c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:46.543903 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap760a1107-1c, col_values=(('qos', UUID('00c9985e-cd50-4b51-b8bc-16815fa8c5ce')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:46.544082 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap760a1107-1c, col_values=(('external_ids', {'iface-id': '760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:35:28', 'vm-uuid': '41124908-2411-4160-b41a-ef09899a2b82'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:46.545060 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.546260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:46.551975 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:46.553010 np0000000663 nova-compute[98103]: INFO os_vif [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c')
May 13 02:06:46.621144 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:46.963311 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1d11912-26e3-4923-82b5-31891ace0f79 req-9eeabb10-6ef3-4950-b3e0-7976174099e4 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-deleted-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:46.963696 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-b1d11912-26e3-4923-82b5-31891ace0f79 req-9eeabb10-6ef3-4950-b3e0-7976174099e4 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Neutron deleted interface 536a799f-3ef3-43a5-bc46-33adc66429e1; detaching it from the instance and deleting it from the info cache
May 13 02:06:46.963696 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b1d11912-26e3-4923-82b5-31891ace0f79 req-9eeabb10-6ef3-4950-b3e0-7976174099e4 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:47.023172 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:47.228364 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:47.229689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] Acquiring lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:47.229897 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:47.230204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] Lock "d8e796d1-f442-4a33-935b-863c6340bbca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:47.230971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] No waiting events found dispatching network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:47.231524 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1e3b2744-70d9-4251-9361-14ef9eabd2d6 req-968ce491-c385-4917-a75c-f6637368fbc7 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Received event network-vif-unplugged-536a799f-3ef3-43a5-bc46-33adc66429e1 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:47.394393 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:47.399583 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:47.399692 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:47.399928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:47.399928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:83:8d:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:47.468393 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1d11912-26e3-4923-82b5-31891ace0f79 req-9eeabb10-6ef3-4950-b3e0-7976174099e4 service nova] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Detach interface failed, port_id=536a799f-3ef3-43a5-bc46-33adc66429e1, reason: Instance d8e796d1-f442-4a33-935b-863c6340bbca could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:06:47.532913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.694s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:47.533069 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Migrating
May 13 02:06:47.533348 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:06:47.896375 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Took 1.37 seconds to deallocate network for instance.
May 13 02:06:48.054200 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:48.054641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:48.054719 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:48.076723 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:48.076846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:06:48.076912 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:8e:35:28, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:06:48.077311 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Using config drive
May 13 02:06:48.211441 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:48.211633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:48.459655 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:06:48.459896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Deleting volume: d5e17c66-f6eb-498a-9579-05dc2395134e {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:06:48.557906 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:48.582724 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:48.716806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:06:48.745226 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Creating config drive at /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.config
May 13 02:06:48.750421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4glv96o {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:48.807180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4glv96o" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:48.978328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e230b68a-cd4e-4660-8c2d-00eea0d9f6c5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.631s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:49.019552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:49.019552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:49.021607 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:49.094736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:49.095123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:49.213932 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:49.287008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:49.340064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.369340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.475133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:49.475133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:49.489840 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.602072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:06:49.643760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db53e89f-507d-422b-bbd5-4f2410e76e21 req-267dec6b-f015-4e65-ba0c-8c48a0ace98a service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:49.646210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db53e89f-507d-422b-bbd5-4f2410e76e21 req-267dec6b-f015-4e65-ba0c-8c48a0ace98a service nova] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:49.646210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db53e89f-507d-422b-bbd5-4f2410e76e21 req-267dec6b-f015-4e65-ba0c-8c48a0ace98a service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:49.646210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db53e89f-507d-422b-bbd5-4f2410e76e21 req-267dec6b-f015-4e65-ba0c-8c48a0ace98a service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:49.646210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db53e89f-507d-422b-bbd5-4f2410e76e21 req-267dec6b-f015-4e65-ba0c-8c48a0ace98a service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Processing event network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:06:49.716261 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:49.726265 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.732592 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.766003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:49.842286 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:49.842450 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:49.977221 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Detaching volume be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:50.020824 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Attempting to driver detach volume be0189f1-ad88-4219-b716-eb9a42301d89 from mountpoint /dev/vdb
May 13 02:06:50.030379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:50.036810 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:50.036964 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Attempting to detach device vdb from instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:50.037281 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:50.037281 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:50.045426 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 from the persistent domain config.
May 13 02:06:50.045936 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] (1/8): Attempting to detach device vdb with device alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 from instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:50.046228 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:50.046228 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:50.185198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:50.269963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:50.272949 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:06:50.273174 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638010.2728088, 41124908-2411-4160-b41a-ef09899a2b82 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:50.273350 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] VM Started (Lifecycle Event)
May 13 02:06:50.279206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:06:50.282511 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance spawned successfully.
May 13 02:06:50.282817 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:06:50.347120 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:50.672768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 for instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:50.776620 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:50.780799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:50.798308 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.798657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.799166 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.800460 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.801115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.803844 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:06:50.854791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.837s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:50.857378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.568s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:50.864014 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:50.864435 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Claim successful on node np0000000663
May 13 02:06:50.922539 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Deleted allocations for instance d8e796d1-f442-4a33-935b-863c6340bbca
May 13 02:06:51.248762 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Starting migrate_disk_and_power_off {{(pid=98103) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 02:06:51.267499 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.275291 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.284707 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:06:51.285053 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638011.2848825, 41124908-2411-4160-b41a-ef09899a2b82 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:51.285310 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] VM Paused (Lifecycle Event)
May 13 02:06:51.292915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.315784 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Took 8.24 seconds to spawn the instance on the hypervisor.
May 13 02:06:51.315985 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:51.442253 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.447564 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.545547 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.598774 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance destroyed successfully.
May 13 02:06:51.602114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:51.602114 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:51.602114 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:51.602114 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:51.602868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.602928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86a2acdd-98, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:51.618225 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.621477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:51.623365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.624176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef95aa18-a30c-4d53-b373-99a6b328f99d) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:51.624531 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.626304 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:51.630101 np0000000663 nova-compute[98103]: INFO os_vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98')
May 13 02:06:51.635406 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:51.635762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:51.635909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:51.636367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:51.637424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:51.637622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:51.672841 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:51.673365 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '54')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:51.673365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '52')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:51.674694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '51')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:51.679453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c61c040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:51.679858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:51.680165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flush multipath device 330000000ee111f48 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:51.737784 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:51.766306 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:51.766765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] No waiting events found dispatching network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received unexpected event network-vif-plugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d for instance with vm_state active and task_state None.
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received unexpected event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with vm_state active and task_state resize_migrating.
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:51.769861 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6bfea586-dc4f-49de-a2ba-bf10778d57b4 req-8fbd9850-cc8a-467a-a80a-ae8da449bf96 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received unexpected event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with vm_state active and task_state resize_migrating.
May 13 02:06:51.785958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:51.789641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:51.791810 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638011.7915127, 41124908-2411-4160-b41a-ef09899a2b82 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:51.792009 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] VM Resumed (Lifecycle Event)
May 13 02:06:51.817859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:51.818139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:51.818297 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:51.818423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:51.818930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:51.822084 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Terminating instance
May 13 02:06:51.837371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:51.837371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:51.837371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:51.837600 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Took 14.18 seconds to build instance.
May 13 02:06:51.853178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:51.853178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:51.867957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:51.913058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260]
May 13 02:06:51.913058 np0000000663 nova-compute[98103]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260] successful.
May 13 02:06:51.913058 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:51.935805 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f0fd347a-c8bb-4baf-9faa-c4077ccdf3ec tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "d8e796d1-f442-4a33-935b-863c6340bbca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.744s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:51.940876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:51.957440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:52.007618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260]
May 13 02:06:52.007618 np0000000663 nova-compute[98103]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260] successful.
May 13 02:06:52.007618 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:52.029729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:52.030113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:52.030328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== disconnect_volume: return (394ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:52.030547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:52.036196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] skipping disk /dev/dm-8 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:06:52.036196 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7_resize/disk.config /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:52.091242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "cp -r /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7_resize/disk.config /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:52.297259 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:52.303130 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:06:52.326515 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:52.344355 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-745f457c-e0cd-4ef1-92fe-17dcd6666d4f tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.699s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:52.355145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.356648 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.361892 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0007975270000315504 future=<Future at 0x705c6c62be90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.362103 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.362103 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.7034307160001845 future=<Future at 0x705c8017f110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.362302 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.703300634000016 future=<Future at 0x705c8017f110 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.364152 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778637997.3608851, e53ce1bc-0ccb-45b9-a44a-0b1313f84af7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:06:52.364152 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] VM Stopped (Lifecycle Event)
May 13 02:06:52.389665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.394603 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.422902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.424279 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.608335 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:52.608335 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:52.608335 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:52.608514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:52.608589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:52.609414 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d329278d-b74d-44e8-adac-bed7edf6af06 req-72bfbb4e-6ced-44ec-8094-239f7e317c62 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:52.678461 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.688569 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:52.690167 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:52.692511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:52.712951 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Instance destroyed successfully.
May 13 02:06:52.714590 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lazy-loading 'resources' on Instance uuid 51c00d54-54b0-41fb-af8e-2cb664c6a463 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:52.807185 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638012.8063643, 2d1c8212-2a2a-4392-89cb-410a0a987de8 => ua-be0189f1-ad88-4219-b716-eb9a42301d89> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:52.807185 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999782364999874 future=<Future at 0x705c6c6656d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.808809 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999574721000045 future=<Future at 0x705c6c664410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:52.812155 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 from the live domain config.
May 13 02:06:52.868857 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: e53ce1bc-0ccb-45b9-a44a-0b1313f84af7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:06:53.195479 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:53.220428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-43898191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionsv293testjson-server-1249907315',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLqgN2vxUFDTnZxNQJ79+BBnrQL3RMR8ytGdzUTjH0ZCiuG9RBenXHEojn0ez1hrJLXg4sN1akOxGKuiAxma/LkP2m7qyzvydQZuU68JwfJOk90yezOWAlvCVoreEoxuQ==',key_name='tempest-keypair-876230572',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:12Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f3e57d4283544449e40b60367c11476',ramdisk_id='',reservation_id='r-wdftse0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='d1473902-f7a7-4b60-ab45-c49394eec657',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1336454500',owner_user_name='tempest-ServerActionsV293TestJSON-1336454500-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ed109293f84e5da5e931ff8db316ba',uuid=51c00d54-54b0-41fb-af8e-2cb664c6a463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:53.220945 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converting VIF {"id": "998fd126-103d-4849-a998-cf1a294e7fed", "address": "fa:16:3e:78:d0:35", "network": {"id": "9ec14a44-fcc9-4738-8e61-6d7207e39388", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-307108807-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0f3e57d4283544449e40b60367c11476", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998fd126-10", "ovs_interfaceid": "998fd126-103d-4849-a998-cf1a294e7fed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:53.222995 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:53.223492 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:53.225867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:53.225867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap998fd126-10, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:53.229923 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:53.232342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:53.233018 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b698204-b891-4878-9e48-2d881bc8973d) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:53.235990 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:53.238141 np0000000663 nova-compute[98103]: INFO os_vif [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:35,bridge_name='br-int',has_traffic_filtering=True,id=998fd126-103d-4849-a998-cf1a294e7fed,network=Network(9ec14a44-fcc9-4738-8e61-6d7207e39388),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998fd126-10')
May 13 02:06:53.241124 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:53.241772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:53.241947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:53.246723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:53.247996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '89609779-0fe1-4836-8b88-0fecdb74ad85', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:53.248338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:53.251964 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:53.252326 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [44] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:53.289049 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:53.290054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '54')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:53.290054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '43')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:53.290609 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85', '44')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:53.291525 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7f4fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:53.291802 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:53.292000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Flush multipath device 3300000002430ed53 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:53.359232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:53.361434 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Detected multiple connections on this host for volume: be0189f1-ad88-4219-b716-eb9a42301d89, skipping target disconnect.
May 13 02:06:53.412729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:53.462442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:53.462808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:53.465175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:53.480674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:53.481971 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:53.485580 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Port 86a2acdd-98ba-4f77-83d6-b7f93793b27f binding to destination host np0000000663 is already ACTIVE {{(pid=98103) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 02:06:53.504474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.524518 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:53.524766 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:53.525004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:53.525225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:53.525418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:53.530012 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Terminating instance
May 13 02:06:53.558553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260]
May 13 02:06:53.558553 np0000000663 nova-compute[98103]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.40.100,3260] successful.
May 13 02:06:53.558553 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.581855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.598866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.649951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260]
May 13 02:06:53.649951 np0000000663 nova-compute[98103]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-89609779-0fe1-4836-8b88-0fecdb74ad85, portal: 192.168.50.100,3260] successful.
May 13 02:06:53.649951 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.668900 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:53.669156 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:53.669406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] <== disconnect_volume: return (427ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:53.669611 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:53.669973 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deleting instance files /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463_del
May 13 02:06:53.671196 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deletion of /opt/stack/data/nova/instances/51c00d54-54b0-41fb-af8e-2cb664c6a463_del complete
May 13 02:06:53.704886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.850s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:53.705747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.521s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:53.705924 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:06:53.716557 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:06:53.716813 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Claim successful on node np0000000663
May 13 02:06:53.939910 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:54.032839 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:06:54.066418 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.070670 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.093940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.097396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.127194 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.127194 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.179334 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Took 1.85 seconds to destroy the instance on the hypervisor.
May 13 02:06:54.179804 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:54.183578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:54.183763 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:54.183996 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:54.213303 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:06:54.213590 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:06:54.214273 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:54.214448 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:54.299335 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:54.304300 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1cf7b3eb74a47aca33e0d7fc78c7b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c88a2c430e64df18a80e42983f49a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:06:54.388960 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999696536000101 future=<Future at 0x705c6c6c37a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:06:54.392334 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Instance destroyed successfully.
May 13 02:06:54.393739 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lazy-loading 'resources' on Instance uuid 1a8c3497-e0fe-475c-ad89-fccdb35ab740 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:54.466670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:54.466943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:54.467082 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:54.467352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:54.467410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] No waiting events found dispatching network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:54.467597 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bd66d6e-5fdc-4fd0-a5f5-c9d33badee81 req-3a4f54e3-d51d-49a9-ad6b-698b5bac70f3 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:54.496134 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:06:54.522475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:54.529995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:54.530136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:54.714814 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:06:54.743735 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:54.743735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Acquiring lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:54.744010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:54.744010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:54.744246 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] No waiting events found dispatching network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:54.744464 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-unplugged-998fd126-103d-4849-a998-cf1a294e7fed for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:54.744694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-changed-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:54.744694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Refreshing instance network info cache due to event network-changed-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:54.744927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Acquiring lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:54.745046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Acquired lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:54.745227 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Refreshing network info cache for port 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:54.898055 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:03:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1123421912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverbootfromvolumestablerescuetest-server-1123421912',id=10,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:59Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32377a41c4fc4e2781fdff3229fc3395',ramdisk_id='',reservation_id='r-s2m2p73e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:04:10Z,user_data=None,user_id='ab7be413eb9340d1af627622a3e917fe',uuid=1a8c3497-e0fe-475c-ad89-fccdb35ab740,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:06:54.898477 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converting VIF {"id": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "address": "fa:16:3e:41:4e:0e", "network": {"id": "e670d9d0-5d39-41b9-9c6b-07c70599f96b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1781053228-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "32377a41c4fc4e2781fdff3229fc3395", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf28677-2d", "ovs_interfaceid": "2cf28677-2d9d-48a5-a0ac-4396d32381c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:54.898820 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:54.905512 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:06:54.905512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.905512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf28677-2d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:54.907414 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:54.908239 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.909565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:54.910181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52a6990f-349a-4e52-a302-c65677b98c08) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:54.912313 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:54.914121 np0000000663 nova-compute[98103]: INFO os_vif [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:4e:0e,bridge_name='br-int',has_traffic_filtering=True,id=2cf28677-2d9d-48a5-a0ac-4396d32381c2,network=Network(e670d9d0-5d39-41b9-9c6b-07c70599f96b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf28677-2d')
May 13 02:06:54.914443 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Deleting instance files /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740_del
May 13 02:06:54.918108 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Deletion of /opt/stack/data/nova/instances/1a8c3497-e0fe-475c-ad89-fccdb35ab740_del complete
May 13 02:06:54.950715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4be84a63-3163-4614-a76d-1a7cc248d492 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.476s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:54.986028 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Successfully created port: a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:06:55.029575 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8fac9082-fe53-427e-ba6c-b85ad2d77230 req-2d630e79-ad32-4996-b9fa-4a646c03ef89 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Received event network-vif-deleted-998fd126-103d-4849-a998-cf1a294e7fed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:55.031451 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-8fac9082-fe53-427e-ba6c-b85ad2d77230 req-2d630e79-ad32-4996-b9fa-4a646c03ef89 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Neutron deleted interface 998fd126-103d-4849-a998-cf1a294e7fed; detaching it from the instance and deleting it from the info cache
May 13 02:06:55.031451 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8fac9082-fe53-427e-ba6c-b85ad2d77230 req-2d630e79-ad32-4996-b9fa-4a646c03ef89 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:55.103930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:55.104141 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:55.218555 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:06:55.251119 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:55.275117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:55.430240 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 02:06:55.431326 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:06:55.431594 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:06:55.431682 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:06:55.431916 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:55.437085 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:55.441864 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:55.539401 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:55.548808 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8fac9082-fe53-427e-ba6c-b85ad2d77230 req-2d630e79-ad32-4996-b9fa-4a646c03ef89 service nova] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Detach interface failed, port_id=998fd126-103d-4849-a998-cf1a294e7fed, reason: Instance 51c00d54-54b0-41fb-af8e-2cb664c6a463 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:06:55.587780 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:55.587780 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:55.609171 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Detaching volume be0189f1-ad88-4219-b716-eb9a42301d89
May 13 02:06:55.635191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:55.638617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:55.638617 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:55.673581 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Attempting to driver detach volume be0189f1-ad88-4219-b716-eb9a42301d89 from mountpoint /dev/vdb
May 13 02:06:55.683571 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:55.685701 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:06:55.685853 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Attempting to detach device vdb from instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:06:55.686078 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:55.686078 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:55.693474 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:55.701634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 from the persistent domain config.
May 13 02:06:55.701972 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] (1/8): Attempting to detach device vdb with device alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 from instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:06:55.702444 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <alias name="ua-be0189f1-ad88-4219-b716-eb9a42301d89"/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <serial>be0189f1-ad88-4219-b716-eb9a42301d89</serial>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]: </disk>
May 13 02:06:55.702444 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:06:55.913909 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Successfully updated port: a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:06:55.943627 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Took 1.76 seconds to deallocate network for instance.
May 13 02:06:56.043674 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:56.091989 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:56.137577 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:56.229109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:06:56.229109 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:56.229109 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Creating image(s)
May 13 02:06:56.230206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:56.230484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:56.231262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:56.232185 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:56.235275 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:56.237443 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:56.275544 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updated VIF entry in instance network info cache for port 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:56.276404 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating instance_info_cache with network_info: [{"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:56.357378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:56.357679 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:56.358356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:56.358846 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:56.362439 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:56.362810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:56.417770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:56.417899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:56.418897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:56.473696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.111s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:56.474242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:56.514210 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:56.534473 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Took 0.59 seconds to detach 1 volumes for instance.
May 13 02:06:56.539125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Deleting volume: 89609779-0fe1-4836-8b88-0fecdb74ad85 {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:06:56.541884 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk 1073741824" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:56.542446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:56.542996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:56.581914 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:56.582574 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] Acquiring lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:56.583453 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:56.583650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:56.583873 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] No waiting events found dispatching network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:56.584058 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b2f0322d-b3f8-436d-87af-26891d8e1d02 req-1ea92a3f-fafe-4b2b-a1c2-99de0ef84bbc service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-unplugged-2cf28677-2d9d-48a5-a0ac-4396d32381c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:06:56.607134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.900s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:56.607764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:06:56.674940 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:56.675391 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:06:56.675627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:56.708729 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:56.782485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c6050e-6132-4b4f-b293-8d780456a2a0 req-9e29de8c-0357-48ce-9976-ed69d4cdfaba service nova] Releasing lock "refresh_cache-41124908-2411-4160-b41a-ef09899a2b82" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:56.785823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:56.786255 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Cannot resize image /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:06:56.786696 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:06:56.786913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Ensure instance console log exists: /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:56.787284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:56.787958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:56.787958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:56.827620 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6ae36688-9e58-47e4-a6b9-79aba1032ba5 req-7010adcb-8550-458e-9a25-5b7926ab80b7 service nova] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Received event network-vif-deleted-2cf28677-2d9d-48a5-a0ac-4396d32381c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:56.939132 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:57.018652 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:57.024448 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Took 1.59 seconds to deallocate network for instance.
May 13 02:06:57.113371 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-changed-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:57.113542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Refreshing instance network info cache due to event network-changed-a5f207e1-53af-4e40-934d-423a19436021. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:57.113709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] Acquiring lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:57.119164 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:06:57.119652 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:06:57.119944 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:57.120166 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:57.141594 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:57.146410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:57.208526 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1cf7b3eb74a47aca33e0d7fc78c7b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c88a2c430e64df18a80e42983f49a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:06:57.234651 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:57.412838 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updating instance_info_cache with network_info: [{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:57.440909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:57.540605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:57.621086 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:06:57.777006 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:57.811355 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Successfully created port: 0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:06:57.914867 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:57.915291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance network_info: |[{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:06:57.915828 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] Acquired lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:57.915997 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Refreshing network info cache for port a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:06:57.918831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start _get_guest_xml network_info=[{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:57.926739 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:57.928568 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2097671582', uuid='86e04c9b-9512-47f6-8849-2c171e65ea18'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638017.9280272) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:57.930070 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:57.930446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:57.933976 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:57.934283 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:57.935354 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:57.935700 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:57.936721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:57.936721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:57.936721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:57.936721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:57.936721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:57.936979 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:57.936979 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:57.937171 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:57.937233 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:57.937385 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:57.952642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2097671582',display_name='tempest-ServerRescueNegativeTestJSON-server-2097671582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-2097671582',id=28,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-t4m1vc32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:55Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=86e04c9b-9512-47f6-8849-2c171e65ea18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:06:57.952848 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:57.953534 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:57.954354 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:06:57.959233 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:57.975292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:06:57.994223 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:57.994530 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:58.002580 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:58.053600 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:06:58.053871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:06:58.064504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:06:58.066148 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c', 'fe80::fc16:3eff:fe8e:3528', 'fe80::d068:bbff:fe8f:a813'] 
May 13 02:06:58.066432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:06:58.066593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:06:58.066862 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:58.132013 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:06:58.425926 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:58.460673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] End _get_guest_xml xml=<domain type="qemu">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <uuid>86e04c9b-9512-47f6-8849-2c171e65ea18</uuid>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <name>instance-0000001c</name>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2097671582</nova:name>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:57</nova:creationTime>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         <nova:port uuid="a5f207e1-53af-4e40-934d-423a19436021">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <system>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="serial">86e04c9b-9512-47f6-8849-2c171e65ea18</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="uuid">86e04c9b-9512-47f6-8849-2c171e65ea18</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </system>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <os>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </os>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <features>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </features>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   <devices>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </disk>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:a0:79:ae"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <target dev="tapa5f207e1-53"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </interface>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/console.log" append="off"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </serial>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <video>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </video>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </rng>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:   </devices>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]: </domain>
May 13 02:06:58.460673 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Preparing to wait for external event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2097671582',display_name='tempest-ServerRescueNegativeTestJSON-server-2097671582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-2097671582',id=28,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-t4m1vc32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:55Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=86e04c9b-9512-47f6-8849-2c171e65ea18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:06:58.462836 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:06:58.463582 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:06:58.463848 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:06:58.464490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.465010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:58.465472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:06:58.466874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.467244 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5623714-948a-5be3-85f7-028f7e3961b4', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:58.468972 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.470117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:58.472612 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Successfully updated port: 0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:06:58.475087 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.475364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f207e1-53, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:58.475807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5f207e1-53, col_values=(('qos', UUID('511e75a6-6e1b-444a-b8da-8c15da7fd5ba')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:58.475993 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5f207e1-53, col_values=(('external_ids', {'iface-id': 'a5f207e1-53af-4e40-934d-423a19436021', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:79:ae', 'vm-uuid': '86e04c9b-9512-47f6-8849-2c171e65ea18'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:06:58.478544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.479977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:06:58.485598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:06:58.487616 np0000000663 nova-compute[98103]: INFO os_vif [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53')
May 13 02:06:58.497807 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:06:58.826291 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:58.976944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:58.977059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:06:58.979187 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:06:59.005289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.860s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.007543 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.467s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.027687 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updated VIF entry in instance network info cache for port a5f207e1-53af-4e40-934d-423a19436021. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:06:59.028112 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updating instance_info_cache with network_info: [{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:06:59.035486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:59.035930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.039378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.040844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.041484 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:06:59.043111 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state building and task_state spawning.
May 13 02:06:59.043432 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-changed-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:06:59.043692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Refreshing instance network info cache due to event network-changed-0d8e5bb1-236d-402f-9f5d-60129fb51d7d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:06:59.043946 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Acquiring lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:06:59.103283 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Deleted allocations for instance 51c00d54-54b0-41fb-af8e-2cb664c6a463
May 13 02:06:59.138315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638019.137593, 49cb3e10-5cb6-4107-a854-b913e5ec46b1 => ua-be0189f1-ad88-4219-b716-eb9a42301d89> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:06:59.139574 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-be0189f1-ad88-4219-b716-eb9a42301d89 for instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:06:59.142398 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 from the live domain config.
May 13 02:06:59.149991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:06:59.151627 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:06:59.153388 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Creating image(s)
May 13 02:06:59.153388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.153636 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.154440 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.155116 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:59.160300 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:59.165423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.201363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:06:59.202277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:59.202566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:59.203601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:59.204034 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'be0189f1-ad88-4219-b716-eb9a42301d89', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:06:59.204354 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:59.241252 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89 (non-flash)
May 13 02:06:59.241955 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:06:59.242258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '54')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:06:59.242374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '54')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:59.244819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89', '53')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:06:59.249113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6aafc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'): ({'sdl'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:06:59.249693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:06:59.250056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flush multipath device 33000000030bd621c {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:06:59.263031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Starting finish_migration {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 02:06:59.264508 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:06:59.264715 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Creating image(s)
May 13 02:06:59.265064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:06:59.265306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Ensure instance console log exists: /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:59.265631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.265873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.266109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.266846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start _get_guest_xml network_info=[{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '81d1e9b6-0f42-49d5-95ee-01273edb45c7', 'attached_at': '2026-05-13T02:06:58.000000', 'detached_at': '', 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'serial': 'c84d870e-7c67-46ef-b733-6926795384a7'}, 'attachment_id': 'a897c026-ab1b-4710-b26b-3a86440f94ff', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:06:59.271655 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:06:59.273432 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-429451115', uuid='81d1e9b6-0f42-49d5-95ee-01273edb45c7'), owner=OwnerMeta(userid='33425a40c04d488bba6393ace2394be5', username='tempest-ServerActionsTestOtherA-1936571963-project-member', projectid='eeca98c5180647b2910bdd1f13ac4196', projectname='tempest-ServerActionsTestOtherA-1936571963'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638019.2726638) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:06:59.274249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:06:59.274633 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:06:59.275426 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:06:59.275652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:06:59.276867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:06:59.277179 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.278829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.278829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.279699 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:06:59.280066 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:59.289911 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:06:59.292718 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:06:59.293134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:59.293354 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:06:59.293473 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:06:59.293575 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:06:59.293970 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:06:59.294110 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:06:59.294276 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:06:59.294395 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:06:59.294654 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:06:59.295013 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:06:59.295579 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.330968 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.343303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:06:59.394262 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:06:59.394262 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:06:59.395906 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:06:59.408954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.409366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.424845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:06:59.426506 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:06:59.444045 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.448944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.449694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.449990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.450584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.451067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:06:59.451496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:06:59.451680 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:59.462905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk 1073741824" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.463328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.463625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.484865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.40.100,3260]
May 13 02:06:59.484865 np0000000663 nova-compute[98103]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.40.100,3260] successful.
May 13 02:06:59.484865 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.517476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.530716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec01ba59-1420-44fd-a359-d9c0d614ace3 req-9a7270c9-a8e4-4f91-9f17-d8a02a065697 service nova] Releasing lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:06:59.536692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.564932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.565331 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:06:59.565390 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:06:59.595394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.50.100,3260]
May 13 02:06:59.595394 np0000000663 nova-compute[98103]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-be0189f1-ad88-4219-b716-eb9a42301d89, portal: 192.168.50.100,3260] successful.
May 13 02:06:59.595394 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.596778 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:06:59.621385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.628533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:06:59.629131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== disconnect_volume: return (426ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:06:59.629350 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:06:59.629946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:59.631797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:06:59.648887 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:59.649657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:59.650067 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:06:59.650856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:06:59.651528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:06:59.651528 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:06:59.671884 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:06:59.672310 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Cannot resize image /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:06:59.672664 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:06:59.672876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Ensure instance console log exists: /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:06:59.679477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:59.679477 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.681466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:06:59.681798 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:06:59.682976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:06:59.682976 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.684037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:06:59.703117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7] added
May 13 02:06:59.703117 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:59.703117 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:59.703117 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:59.703117 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:59.703117 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:59.703117 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.703416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:59.704343 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0542(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:59.704634 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:59.705290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7] added
May 13 02:06:59.705290 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:06:59.705290 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:59.705290 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:59.705290 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:06:59.705290 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:06:59.705290 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:06:59.705610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:06:59.705898 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0543(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:06:59.706122 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:06:59.821515 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:06:59.978890 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:06:59.979483 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:06:59.999964 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updating instance_info_cache with network_info: [{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:00.030662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:00.030662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:00.030662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:a0:79:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:00.031601 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Using config drive
May 13 02:07:00.066056 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004846399999678397 future=<Future at 0x705c8017f110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:00.066251 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:00.066383 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.7405880759999945 future=<Future at 0x705c6c6656d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:00.066383 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.740503168000032 future=<Future at 0x705c6c6656d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:00.066788 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778638005.0654545, d8e796d1-f442-4a33-935b-863c6340bbca => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:00.066853 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] VM Stopped (Lifecycle Event)
May 13 02:07:00.117814 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2b3832ef-9b2a-47af-acd8-f2b0773b0ed9 tempest-ServerActionsV293TestJSON-1336454500 tempest-ServerActionsV293TestJSON-1336454500-project-member] Lock "51c00d54-54b0-41fb-af8e-2cb664c6a463" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.299s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:00.214956 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:00.274213 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:00.482637 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:00.502925 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:00.503644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance network_info: |[{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:00.506886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Acquired lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:00.506886 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Refreshing network info cache for port 0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:00.507666 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start _get_guest_xml network_info=[{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:00.511438 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:00.513109 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-657084789', uuid='12c32a90-8f0e-4a43-b818-c86882b54d00'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638020.5125968) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:00.514939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:00.515753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:00.517219 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:00.517511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:00.518738 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:00.519144 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:00.519341 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:00.519566 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:00.519863 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:00.520024 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:00.520592 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:00.520592 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:00.520722 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:00.520831 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:00.521010 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:00.521433 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:00.538525 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:00.544348 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-657084789',display_name='tempest-ServerRescueNegativeTestJSON-server-657084789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-657084789',id=29,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-3jqguyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:58Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=12c32a90-8f0e-4a43-b818-c86882b54d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:00.544742 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:00.545390 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:00.546080 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:00.569730 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: d8e796d1-f442-4a33-935b-863c6340bbca] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:00.694633 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Creating config drive at /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config
May 13 02:07:00.699317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaczh1tlg {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:00.715943 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.717319 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:00.718193 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:00.725459 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.732736 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.733621 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:00.735898 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:00.735898 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.739752 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.739752 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.740329 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.740590 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:07:00.743296 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:00.745919 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:00.745919 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.752671 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.760473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.770445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaczh1tlg" returned: 0 in 0.069s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.772441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.772763 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.786953 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.787393 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:00.814471 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260]
May 13 02:07:00.814471 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260] successful.
May 13 02:07:00.814471 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.833110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.849213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260]
May 13 02:07:00.849213 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260] successful.
May 13 02:07:00.849213 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.850587 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.850874 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:00.851791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:00.851791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:00.852536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('9', '-', '-', 0) found on session 55 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:00.852690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:00.864757 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:00.879596 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 55 and hctl ['9', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.898980 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:00.903420 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.250s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] HCTL ('10', '-', '-', 0) found on session 56 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:00.903420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:00.927522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 56 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:00.927768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:00.993215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.985s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:01.011593 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:01.022012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <uuid>12c32a90-8f0e-4a43-b818-c86882b54d00</uuid>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <name>instance-0000001d</name>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-657084789</nova:name>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:00</nova:creationTime>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         <nova:port uuid="0d8e5bb1-236d-402f-9f5d-60129fb51d7d">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="serial">12c32a90-8f0e-4a43-b818-c86882b54d00</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="uuid">12c32a90-8f0e-4a43-b818-c86882b54d00</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:fd:64:8a"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <target dev="tap0d8e5bb1-23"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/console.log" append="off"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:01.053117 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Preparing to wait for external event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:01.053117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-657084789',display_name='tempest-ServerRescueNegativeTestJSON-server-657084789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-657084789',id=29,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-3jqguyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:58Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=12c32a90-8f0e-4a43-b818-c86882b54d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:01.058111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:01.062303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.062656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5de9d9c-939f-5945-a5f4-ccf766bb8351', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:01.066040 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:01.074868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.078843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.079075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d8e5bb1-23, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:01.079578 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d8e5bb1-23, col_values=(('qos', UUID('dbfab494-9dc6-44e8-9b96-5d15bb64609f')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:01.079747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d8e5bb1-23, col_values=(('external_ids', {'iface-id': '0d8e5bb1-236d-402f-9f5d-60129fb51d7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:64:8a', 'vm-uuid': '12c32a90-8f0e-4a43-b818-c86882b54d00'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:01.082547 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:01.094111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.098622 np0000000663 nova-compute[98103]: INFO os_vif [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23')
May 13 02:07:01.143781 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Deleted allocations for instance 1a8c3497-e0fe-475c-ad89-fccdb35ab740
May 13 02:07:01.234610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-716ec3f8-2c06-45fc-a18c-df3f6e70c68f tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.130s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:01.256664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:01.256664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:01.256664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:01.256664 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:07:01.358411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.391929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.395818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.526064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.785077 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.796703 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.797720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.831448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.842743 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:01.845655 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:01.880375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Searching for a device in session 55 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:01.880760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:02.162049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b56605d8-6bd7-4eea-b178-5d8b5a4dd76e tempest-ServerBootFromVolumeStableRescueTest-1279205887 tempest-ServerBootFromVolumeStableRescueTest-1279205887-project-member] Lock "1a8c3497-e0fe-475c-ad89-fccdb35ab740" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.637s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:02.325007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:02.519416 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638022.5183332, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:02.519416 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Started (Lifecycle Event)
May 13 02:07:02.594014 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updated VIF entry in instance network info cache for port 0d8e5bb1-236d-402f-9f5d-60129fb51d7d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:02.594014 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updating instance_info_cache with network_info: [{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:02.629787 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:02.629982 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:02.630313 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:fd:64:8a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:02.630996 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Using config drive
May 13 02:07:02.681395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:02.698380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Found WWN 330000000ee111f48 for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:07:02.699784 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.070s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:02.699784 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== connect_volume: return (3247ms) {'type': 'block', 'scsi_wwn': '330000000ee111f48', 'path': '/dev/dm-1', 'multipath_id': '330000000ee111f48'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:02.699955 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee111f48', 'path': '/dev/dm-1', 'multipath_id': '330000000ee111f48'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:07:02.710056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:02.783672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:02.784281 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:02.893809 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:02.895158 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Periodic task is updating the host stat, it is trying to get disk instance-0000001d, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config'
May 13 02:07:02.909986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:07:02.910161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:07:02.910281 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-15 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:07:02.913767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.023038 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:03.028276 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638023.0278516, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:03.028515 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Paused (Lifecycle Event)
May 13 02:07:03.036030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.036455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.095063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d635a16-4d3c-443e-a7a9-33629bb4e93e req-b7c24ac9-6466-4489-a96d-4c3a614662c5 service nova] Releasing lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:03.143106 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:03.164392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.171503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.189070 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.223275 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:03.223528 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:03.224489 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:03.231142 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <uuid>81d1e9b6-0f42-49d5-95ee-01273edb45c7</uuid>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <name>instance-0000001a</name>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <memory>262144</memory>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerActionsTestOtherA-server-429451115</nova:name>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:06:59</nova:creationTime>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.micro" id="84">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:memory>256</nova:memory>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:user uuid="33425a40c04d488bba6393ace2394be5">tempest-ServerActionsTestOtherA-1936571963-project-member</nova:user>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:project uuid="eeca98c5180647b2910bdd1f13ac4196">tempest-ServerActionsTestOtherA-1936571963</nova:project>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         <nova:port uuid="86a2acdd-98ba-4f77-83d6-b7f93793b27f">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="serial">81d1e9b6-0f42-49d5-95ee-01273edb45c7</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="uuid">81d1e9b6-0f42-49d5-95ee-01273edb45c7</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/disk.config"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <alias name="ua-c84d870e-7c67-46ef-b733-6926795384a7"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <serial>c84d870e-7c67-46ef-b733-6926795384a7</serial>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:fa:f1:84"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <target dev="tap86a2acdd-98"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7/console.log" append="off"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:03.231142 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:03.231142 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:03.231142 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-321100948-network", "vif_mac": "fa:16:3e:fa:f1:84"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:03.234284 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:03.234284 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:03.234284 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.234663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:03.235078 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:03.237928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.237928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2671660-6da7-5b13-acb9-26b7ec603e6c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:03.237928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.238694 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:03.245978 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.250981 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.251361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86a2acdd-98, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:03.251909 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86a2acdd-98, col_values=(('qos', UUID('5f700995-e2f3-4c5e-9aea-fddc3718a3f4')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:03.252174 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86a2acdd-98, col_values=(('external_ids', {'iface-id': '86a2acdd-98ba-4f77-83d6-b7f93793b27f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:f1:84', 'vm-uuid': '81d1e9b6-0f42-49d5-95ee-01273edb45c7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:03.253260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.254807 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:03.266962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:03.268023 np0000000663 nova-compute[98103]: INFO os_vif [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98')
May 13 02:07:03.281586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.282039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.416144 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.433657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:07:03.436953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.541259 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Creating config drive at /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config
May 13 02:07:03.545499 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:03.551067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1z0bhzs7 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.570678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.572993 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.598150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:03.619515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1z0bhzs7" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.678164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.682309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.743980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7a202efe-7e36-4271-989e-d5f6cbe00be5 req-3520d6e5-deee-454b-841f-a1bf40537e9d service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:03.746566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7a202efe-7e36-4271-989e-d5f6cbe00be5 req-3520d6e5-deee-454b-841f-a1bf40537e9d service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:03.748632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7a202efe-7e36-4271-989e-d5f6cbe00be5 req-3520d6e5-deee-454b-841f-a1bf40537e9d service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:03.748632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7a202efe-7e36-4271-989e-d5f6cbe00be5 req-3520d6e5-deee-454b-841f-a1bf40537e9d service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:03.748632 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7a202efe-7e36-4271-989e-d5f6cbe00be5 req-3520d6e5-deee-454b-841f-a1bf40537e9d service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Processing event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:03.748632 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:03.759150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:03.762016 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance spawned successfully.
May 13 02:07:03.762795 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:03.805245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.805861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:03.915438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:03.922939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:07:03.928005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:04.025763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:04.026022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:04.031343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:04.032048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:04.104745 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:04.105157 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638024.1048207, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:04.105346 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Resumed (Lifecycle Event)
May 13 02:07:04.140150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:04.143363 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:04.144367 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:04.188606 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.201495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:04.201868 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12457MB free_disk=74.42831039428711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:07:04.202108 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:04.202283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:04.228086 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.231956 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.281587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.281587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.281834 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.282114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.282579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.282718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:04.343155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.348509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.360300 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:04.413464 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa851156-c235-4a21-8792-80ddca7ef538 req-088f0cf8-6544-4929-9e4a-b07d487878fb service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:04.415063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa851156-c235-4a21-8792-80ddca7ef538 req-088f0cf8-6544-4929-9e4a-b07d487878fb service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:04.415063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa851156-c235-4a21-8792-80ddca7ef538 req-088f0cf8-6544-4929-9e4a-b07d487878fb service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:04.415435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa851156-c235-4a21-8792-80ddca7ef538 req-088f0cf8-6544-4929-9e4a-b07d487878fb service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:04.415435 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa851156-c235-4a21-8792-80ddca7ef538 req-088f0cf8-6544-4929-9e4a-b07d487878fb service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Processing event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:04.528387 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:07:04.609298 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:04.614476 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:04.787457 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Took 8.56 seconds to spawn the instance on the hypervisor.
May 13 02:07:04.787610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:04.830649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:04.830649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:04.830649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] No VIF found with MAC fa:16:3e:fa:f1:84, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:04.830649 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Using config drive
May 13 02:07:05.118146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:05.122413 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:05.228740 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Applying migration context for instance 81d1e9b6-0f42-49d5-95ee-01273edb45c7 as it has an incoming, in-progress migration ce28afbb-8992-4d3e-9f4d-2ee7b398cfcd. Migration status is post-migrating {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 13 02:07:05.229894 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating resource usage from migration ce28afbb-8992-4d3e-9f4d-2ee7b398cfcd
May 13 02:07:05.283193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:05.306637 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Took 16.08 seconds to build instance.
May 13 02:07:05.320879 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638025.3203807, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:05.320951 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Started (Lifecycle Event)
May 13 02:07:05.323406 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:05.327056 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.328532 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.328733 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 71da4951-934a-4b63-b242-61f4e395eaf8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.328880 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.329001 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.329136 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 41124908-2411-4160-b41a-ef09899a2b82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.329314 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Migration ce28afbb-8992-4d3e-9f4d-2ee7b398cfcd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 13 02:07:05.329554 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 81d1e9b6-0f42-49d5-95ee-01273edb45c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.330321 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 86e04c9b-9512-47f6-8849-2c171e65ea18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.330559 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 12c32a90-8f0e-4a43-b818-c86882b54d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:07:05.334650 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:05.347643 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance spawned successfully.
May 13 02:07:05.347858 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:05.357893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:05.400738 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:05.501603 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:05.550698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:05.811559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.599s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:05.825623 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:05.831928 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:05.835743 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 02:07:05.836973 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:07:05.836973 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2496MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:07:04 up 30 min,  2 users,  load average: 8.39, 6.15, 3.09\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_eeca98c5180647b2910bdd1f13ac4196': '2', 'io_workload': '2', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '3', 'num_proj_f2064c6bb5ec4e528d35b2ba7473eada': '1', 'num_task_resize_finish': '1', 'num_proj_4b9a7e74db544084a4907abd0f241e8b': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_2c88a2c430e64df18a80e42983f49a4b': '2'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:07:05.857613 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.860123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.860123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.860123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.862826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.862826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:05.891036 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-90e42dd2-f8db-4170-a3ae-dc49fcc3cdde req-cfe946b4-20bf-4908-8f1c-cf4e9209ad7e service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state None.
May 13 02:07:06.340040 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:06.340040 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638026.338197, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:06.340040 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Paused (Lifecycle Event)
May 13 02:07:06.371767 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Took 7.22 seconds to spawn the instance on the hypervisor.
May 13 02:07:06.371767 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:06.434546 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:06.520557 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:06.520840 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:06.521113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:06.521325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:06.521527 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:06.521701 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c3615744-2b23-4edd-8d8a-acdc19a28459 req-4c16d64b-cb56-4737-b1f2-49f3b49f340e service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state active and task_state None.
May 13 02:07:06.570049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:06.579389 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance running successfully.
May 13 02:07:06.583192 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Failed to set time: agent not configured {{(pid=98103) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 02:07:06.583192 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dd2a0aa4-0520-400d-82b7-cf8f56160035 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] finish_migration finished successfully. {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 02:07:06.669594 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:06.669594 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:06.846955 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:06.847869 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638026.8471262, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:06.847869 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Resumed (Lifecycle Event)
May 13 02:07:06.899844 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Took 16.78 seconds to build instance.
May 13 02:07:07.174437 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:07.351421 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:07.357668 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:07.404059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b8aa973-ed46-4caa-8ef9-3d254259e269 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.309s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:07.682362 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:07:07.682554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.480s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:07.683249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.566s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:07.683503 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.16 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:07:07.687902 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:07:07.688083 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Claim successful on node np0000000663
May 13 02:07:07.808586 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.001628760000130569 future=<Future at 0x705c6c6656d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.808896 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.809037 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0016996609999750945 future=<Future at 0x705c6c664410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.809290 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0018524859999615728 future=<Future at 0x705c6c664410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.809290 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.810109 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.5792840640001486 future=<Future at 0x705c6c6c37a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.810499 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778638012.8068538, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:07.810883 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.5777362170001652 future=<Future at 0x705c6c6c37a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:07.811333 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Emitting event <LifecycleEvent: 1778638012.8072658, 51c00d54-54b0-41fb-af8e-2cb664c6a463 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:07.811554 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Stopped (Lifecycle Event)
May 13 02:07:07.813290 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] VM Stopped (Lifecycle Event)
May 13 02:07:07.864250 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 81d1e9b6-0f42-49d5-95ee-01273edb45c7 due to new event <LifecycleEvent: 1778638027.8634272, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:07:07.864398 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638027.8634272, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:07.864671 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Resumed (Lifecycle Event)
May 13 02:07:07.954908 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Rescuing
May 13 02:07:07.954908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:07.954908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:07.954908 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:08.253895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:08.304808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:08.304946 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:08.305123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Going to confirm migration 2 {{(pid=98103) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 02:07:08.320247 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d502f2a7-6668-4b21-a9d9-c539de67c0c5 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 51c00d54-54b0-41fb-af8e-2cb664c6a463] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:08.321001 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e7b41bca-b4de-41ec-b653-90866a0e0bd6 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:08.368688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:08.374768 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:08.457691 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:08.751401 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:08.751476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:08.814228 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:08.880395 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638028.8780577, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:08.880395 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Started (Lifecycle Event)
May 13 02:07:08.956119 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:08.956693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:08.957824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquired lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:08.957824 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:08.957824 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'info_cache' on Instance uuid 81d1e9b6-0f42-49d5-95ee-01273edb45c7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:08.962434 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:09.160323 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updating instance_info_cache with network_info: [{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:09.256316 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:07:09.386086 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:09.389007 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00033955099979721126 future=<Future at 0x705c6c6c37a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:09.389373 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:09.391468 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] Emitting event <LifecycleEvent: 1778638014.3885694, 1a8c3497-e0fe-475c-ad89-fccdb35ab740 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:09.391672 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] VM Stopped (Lifecycle Event)
May 13 02:07:09.395485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:09.506127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:09.507141 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:09.662767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-12c32a90-8f0e-4a43-b818-c86882b54d00" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:09.817173 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:09.895564 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fa2f97d7-94ff-41dc-adde-40497b0a3947 tempest-ServerActionsTestOtherB-810999869 tempest-ServerActionsTestOtherB-810999869-project-member] [instance: 1a8c3497-e0fe-475c-ad89-fccdb35ab740] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:09.970268 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:10.010311 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:10.291118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:10.335549 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:10.515079 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [{"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:10.519121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.836s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:10.521578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:07:10.525803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.709s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:10.532191 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:07:10.532191 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Claim successful on node np0000000663
May 13 02:07:11.021606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Releasing lock "refresh_cache-81d1e9b6-0f42-49d5-95ee-01273edb45c7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:11.021866 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'migration_context' on Instance uuid 81d1e9b6-0f42-49d5-95ee-01273edb45c7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:11.034309 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:07:11.034981 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:07:11.037715 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:11.041601 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:11.070442 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:11.070442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:11.070442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:11.070442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:11.070442 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:11.070657 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-abb58f6e-0d0e-42be-a023-28b1310363ec req-1c4ec080-dfae-4dec-81d9-6df1879b9ae9 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received unexpected event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with vm_state resized and task_state None.
May 13 02:07:11.186480 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:07:11.286672 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:11.289849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:11.322767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:11.447778 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:11.456987 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:11.495739 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:11.495739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:11.495739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:11.495739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:11.495989 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:11.496113 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a116f370-e987-4638-8929-8c0030acc936 req-c70bef62-421a-43a3-ad79-a8b3cf236525 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state active and task_state rescuing.
May 13 02:07:11.526002 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Object Instance<81d1e9b6-0f42-49d5-95ee-01273edb45c7> lazy-loaded attributes: info_cache,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:11.535242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:11.539240 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:07:11.626707 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999631344999898 future=<Future at 0x705c6c7e65d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:11.626707 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.996470890999944 future=<Future at 0x705c6c7e65d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:11.627012 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.996081838999999 future=<Future at 0x705c6c7e65d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:11.629671 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance destroyed successfully.
May 13 02:07:11.630184 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'numa_topology' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:11.875416 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Successfully created port: a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:07:12.042930 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:07:12.139769 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Attempting rescue
May 13 02:07:12.140592 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:07:12.145329 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:07:12.145717 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Creating image(s)
May 13 02:07:12.146310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:12.146522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:12.147170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:12.147397 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:12.322282 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:12.322517 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:12.507652 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Successfully updated port: a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:07:12.649525 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:12.650068 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:12.652550 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:12.655898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:12.655898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:12.655898 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:12.657306 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:12.657655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:12.749202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:12.749703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:12.807940 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:12.812016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:12.812502 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'migration_context' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:12.827815 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:13.013501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:13.013631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:13.013746 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:13.056724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:07:13.057976 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:07:13.058657 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Creating image(s)
May 13 02:07:13.064299 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:13.064472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.064957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.066662 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:13.070058 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:13.073986 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:13.166909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:13.169378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:13.169378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.169378 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:13.175005 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:13.176856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:13.180452 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:13.195616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:13.197630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.197950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.198351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:13.198603 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received unexpected event network-vif-plugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with vm_state resized and task_state None.
May 13 02:07:13.198821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:13.199040 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing instance network info cache due to event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:13.199248 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:13.258524 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:13.273508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:13.277109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:13.316580 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:13.317305 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:13.318200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start _get_guest_xml network_info=[{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:fd:64:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:13.318586 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:13.337033 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.812s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.337769 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:07:13.340737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 1.811s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.344565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk 1073741824" returned: 0 in 0.070s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:13.347642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.348324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:13.455433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:13.458684 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:07:13.458684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:13.559581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Ensure instance console log exists: /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.562366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.564648 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:13.566500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:13.566709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:13.566859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:13.566993 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:13.567150 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e4789742-a793-4b4e-93c7-9e477f1b6263 req-1b782ca9-5225-4416-a42d-204c8b3c3911 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state active and task_state rescuing.
May 13 02:07:13.597777 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:13.759410 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:13.821692 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:13.828354 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:13.830054 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-657084789', uuid='12c32a90-8f0e-4a43-b818-c86882b54d00'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:fd:64:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638033.829546) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:13.833487 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:13.833893 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:13.834779 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:13.834967 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:13.836037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:13.836452 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:13.836606 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:13.836816 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:13.836968 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:13.837067 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:13.837206 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:13.837372 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:13.837487 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:13.837616 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:13.837738 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:13.837875 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:13.838058 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:13.856967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:07:13.861458 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:07:13.862834 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:13.864005 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:13.980592 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:13.983377 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c48805ea23124cb188bc686600c2f9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9eeb94f4b745e38a31c2a39079ce9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:07:14.344406 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:14.361746 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:07:14.368831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-657084789',display_name='tempest-ServerRescueNegativeTestJSON-server-657084789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-657084789',id=29,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:06Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-3jqguyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:06Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=12c32a90-8f0e-4a43-b818-c86882b54d00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:fd:64:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:14.368831 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:fd:64:8a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:14.369549 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:14.370205 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:14.488698 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:14.488938 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance network_info: |[{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:14.491386 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start _get_guest_xml network_info=[{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:14.491822 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:14.492029 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:14.498290 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:14.499723 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='035777fc-feb7-4c85-97f5-322ea3fb60a7'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638034.4992962) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:14.503873 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:14.504446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:14.506241 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:14.506843 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:14.507558 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:14.508379 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:14.508379 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:14.508379 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:14.508578 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:14.508747 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:14.508810 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:14.509005 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:14.509346 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:14.509638 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:14.512334 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:14.512334 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:14.535876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:14.536199 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:14.536659 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:14.537203 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:14.709694 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Successfully created port: 55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:07:14.721161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:14.721377 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:14.865972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:07:14.871948 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:14.873196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <uuid>12c32a90-8f0e-4a43-b818-c86882b54d00</uuid>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <name>instance-0000001d</name>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-657084789</nova:name>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:13</nova:creationTime>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         <nova:port uuid="0d8e5bb1-236d-402f-9f5d-60129fb51d7d">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="serial">12c32a90-8f0e-4a43-b818-c86882b54d00</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="uuid">12c32a90-8f0e-4a43-b818-c86882b54d00</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config.rescue"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:fd:64:8a"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <target dev="tap0d8e5bb1-23"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/console.log" append="off"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:14.873196 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:14.890010 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance destroyed successfully.
May 13 02:07:14.994432 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:15.040057 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <uuid>035777fc-feb7-4c85-97f5-322ea3fb60a7</uuid>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <name>instance-0000001e</name>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-0</nova:name>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:14</nova:creationTime>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         <nova:port uuid="a71035b8-9f4c-437d-b410-614dc6551a90">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="serial">035777fc-feb7-4c85-97f5-322ea3fb60a7</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="uuid">035777fc-feb7-4c85-97f5-322ea3fb60a7</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:53:33:ed"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <target dev="tapa71035b8-9f"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/console.log" append="off"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:15.040057 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Preparing to wait for external event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:15.042831 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:15.045013 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:15.045013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.045013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:15.045013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:15.046566 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.046820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5f59973-ba59-554c-a730-07fd464856c2', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:15.048236 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.049263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:15.056390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.059247 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.059446 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa71035b8-9f, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:15.059773 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa71035b8-9f, col_values=(('qos', UUID('989d8e54-ca23-4114-90d5-1719151160f9')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:15.059919 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa71035b8-9f, col_values=(('external_ids', {'iface-id': 'a71035b8-9f4c-437d-b410-614dc6551a90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:33:ed', 'vm-uuid': '035777fc-feb7-4c85-97f5-322ea3fb60a7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:15.061089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.064663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:15.075527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.079230 np0000000663 nova-compute[98103]: INFO os_vif [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f')
May 13 02:07:15.226492 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:15.276722 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Successfully updated port: 55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:07:15.294898 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:15.348119 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:15.355180 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-changed-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:15.355324 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Refreshing instance network info cache due to event network-changed-55004634-53db-4c39-a811-a8b1a6a35417. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:15.356037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] Acquiring lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:15.357309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] Acquired lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:15.357309 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Refreshing network info cache for port 55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:15.538762 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updated VIF entry in instance network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:15.538762 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:15.783479 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:15.858748 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:15.877188 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:07:15.878041 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:07:15.878320 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Creating image(s)
May 13 02:07:15.878746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:15.878901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:15.880061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:15.880602 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:15.886771 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:15.888753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:15.965480 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:15.992795 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:15.993264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:15.993756 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:15.994309 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:15.998803 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:15.999262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:16.041130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd7c6879-40fe-457f-80a8-6ed32aa4d102 req-9c64166b-55c7-4226-9294-8a9ac0c21763 service nova] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:16.126751 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:16.127318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:16.187629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk 1073741824" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:16.188159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:16.188534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:16.214503 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:16.241512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.901s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:16.294625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:16.295010 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:07:16.295449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:16.410957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:16.411608 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Cannot resize image /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:07:16.412178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:16.412290 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:07:16.412627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:16.412883 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:16.413062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:16.425545 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:16.425766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:16.425878 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:16.426036 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:fd:64:8a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:16.426895 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Using config drive
May 13 02:07:16.610718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:16.610877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:16.610987 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:53:33:ed, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:16.611529 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Using config drive
May 13 02:07:16.721779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-600e6164-f6d8-49b5-9c37-c379023810c2 req-27d8dc79-1816-4903-a9a2-1065110d2d7f service nova] Releasing lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:16.723438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquired lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:16.723668 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:16.897609 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Deleted allocation for migration ce28afbb-8992-4d3e-9f4d-2ee7b398cfcd
May 13 02:07:16.931440 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'ec2_ids' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:17.119892 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:17.278394 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03a1f994-6c22-49ae-9af2-59f62779f3c3 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Get console output
May 13 02:07:17.285732 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Creating config drive at /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config
May 13 02:07:17.294706 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe4mfl8qi {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:17.323725 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:17.364572 np0000000663 nova-compute[98103]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 13 02:07:17.371813 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe4mfl8qi" returned: 0 in 0.077s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:17.402995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4012f9fe-9bbb-4b57-99cc-b7c1e9c74d6f tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.097s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:17.438362 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:17.439827 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'keypairs' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:17.547123 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:17.730439 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating instance_info_cache with network_info: [{"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:17.903295 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:17.939414 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:17.945599 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<12c32a90-8f0e-4a43-b818-c86882b54d00> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:17.951742 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:17.955826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.047195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.076119 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.084865 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.174419 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Creating config drive at /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config.rescue
May 13 02:07:18.178011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpacju2jx0 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:18.237738 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a16a739c-8c20-4aaf-8764-eb90c8814cb6 req-655c3d71-1e9b-43fe-8d84-add307bebb24 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:18.238006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a16a739c-8c20-4aaf-8764-eb90c8814cb6 req-655c3d71-1e9b-43fe-8d84-add307bebb24 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:18.238654 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a16a739c-8c20-4aaf-8764-eb90c8814cb6 req-655c3d71-1e9b-43fe-8d84-add307bebb24 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:18.239724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a16a739c-8c20-4aaf-8764-eb90c8814cb6 req-655c3d71-1e9b-43fe-8d84-add307bebb24 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:18.240943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Releasing lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:18.241267 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a16a739c-8c20-4aaf-8764-eb90c8814cb6 req-655c3d71-1e9b-43fe-8d84-add307bebb24 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Processing event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:18.242284 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance network_info: |[{"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:18.248176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Start _get_guest_xml network_info=[{"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:18.251996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpacju2jx0" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:18.256644 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:18.258077 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-930831195', uuid='c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa'), owner=OwnerMeta(userid='c48805ea23124cb188bc686600c2f9f8', username='tempest-VolumesExtendAttachedTest-1785069232-project-member', projectid='ec9eeb94f4b745e38a31c2a39079ce9c', projectname='tempest-VolumesExtendAttachedTest-1785069232'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638038.2576609) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:18.263230 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:18.264043 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:18.267411 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:18.267411 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:18.269538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:18.270031 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:18.282974 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-930831195',display_name='tempest-VolumesExtendAttachedTest-instance-930831195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesextendattachedtest-instance-930831195',id=31,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYAOknbOrFnvQscAGrKlSzg+VefUlSG08ho6pgvuVwiXVI0FcNaX0gdyOb2U/ieWcojbUvDaOLL0H8M9t4XI9m2xSw4NLtFEURdupDDqVplwXQiaiHtBFxzztEKIxRsMQ==',key_name='tempest-keypair-452794165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9eeb94f4b745e38a31c2a39079ce9c',ramdisk_id='',reservation_id='r-x9d79cg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1785069232',owner_user_name='tempest-VolumesExtendAttachedTest-1785069232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48805ea23124cb188bc686600c2f9f8',uuid=c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:18.283221 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converting VIF {"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:18.284009 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:18.284577 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lazy-loading 'pci_devices' on Instance uuid c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:18.790768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <uuid>c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa</uuid>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <name>instance-0000001f</name>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-930831195</nova:name>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:18</nova:creationTime>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:user uuid="c48805ea23124cb188bc686600c2f9f8">tempest-VolumesExtendAttachedTest-1785069232-project-member</nova:user>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:project uuid="ec9eeb94f4b745e38a31c2a39079ce9c">tempest-VolumesExtendAttachedTest-1785069232</nova:project>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         <nova:port uuid="55004634-53db-4c39-a811-a8b1a6a35417">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="serial">c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="uuid">c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.config"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7e:fd:46"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <target dev="tap55004634-53"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/console.log" append="off"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:18.790768 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:18.795170 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Preparing to wait for external event network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:18.795170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:18.795170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:18.795170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:18.795431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-930831195',display_name='tempest-VolumesExtendAttachedTest-instance-930831195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesextendattachedtest-instance-930831195',id=31,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYAOknbOrFnvQscAGrKlSzg+VefUlSG08ho6pgvuVwiXVI0FcNaX0gdyOb2U/ieWcojbUvDaOLL0H8M9t4XI9m2xSw4NLtFEURdupDDqVplwXQiaiHtBFxzztEKIxRsMQ==',key_name='tempest-keypair-452794165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec9eeb94f4b745e38a31c2a39079ce9c',ramdisk_id='',reservation_id='r-x9d79cg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1785069232',owner_user_name='tempest-VolumesExtendAttachedTest-1785069232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48805ea23124cb188bc686600c2f9f8',uuid=c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:18.795431 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converting VIF {"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:18.795920 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:18.796172 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:18.796512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.796806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:18.797042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:18.798287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.798725 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71cc1a29-1eb4-5a60-81f7-c36be7e25947', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:18.799193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.799885 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:18.806814 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.811753 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.811753 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55004634-53, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:18.811934 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55004634-53, col_values=(('qos', UUID('58561380-958e-4f8a-ac0a-8158b79fc546')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:18.812200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55004634-53, col_values=(('external_ids', {'iface-id': '55004634-53db-4c39-a811-a8b1a6a35417', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:fd:46', 'vm-uuid': 'c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:18.814316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.814794 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:18.831801 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.832846 np0000000663 nova-compute[98103]: INFO os_vif [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53')
May 13 02:07:18.871695 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.872243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.970337 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638038.9698613, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:18.974457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:18.974776 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Started (Lifecycle Event)
May 13 02:07:18.979124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:18.986388 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:18.993183 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance spawned successfully.
May 13 02:07:18.993703 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:19.001108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:19.012939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:19.075492 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:19.075667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:19.075837 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:19.075954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:19.076066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:19.078173 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-9c71596e-a96a-4f08-8b17-326a181b5009 req-e1a79e38-b553-4a4c-ab5d-2de6d1d838b2 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state active and task_state rescuing.
May 13 02:07:19.477524 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:19.480032 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.508345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:19.982742 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:19.983217 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638039.9828248, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:19.983217 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Paused (Lifecycle Event)
May 13 02:07:19.992275 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-24bae7ff-c253-4241-a9ca-9c121682eb51 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:20.027380 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Took 6.97 seconds to spawn the instance on the hypervisor.
May 13 02:07:20.029119 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:20.306760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:20.318205 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:20.318416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:20.318589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:20.318736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:20.318902 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:20.319003 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-14eb1b3c-7659-4744-96c2-78670a4570c8 req-c5e2c6a0-6ab7-42f8-a28e-c8c4e5332dd1 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received unexpected event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with vm_state active and task_state None.
May 13 02:07:20.363657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:20.363657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:20.363930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No VIF found with MAC fa:16:3e:7e:fd:46, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:20.364268 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Using config drive
May 13 02:07:20.490338 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:20.493101 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638040.4927425, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:20.493316 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Resumed (Lifecycle Event)
May 13 02:07:20.547413 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Took 15.51 seconds to build instance.
May 13 02:07:20.871563 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:20.997490 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:21.005986 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:21.053680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.026s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:21.059596 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Creating config drive at /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.config
May 13 02:07:21.064818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7yr9l4kd {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:21.150608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7yr9l4kd" returned: 0 in 0.085s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:21.177561 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:21.177926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:21.178784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:21.178979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:21.179673 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:21.179744 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8ff4b01a-115c-4f38-a2d2-3abafd5fd37d req-263e6d2f-7e02-4f58-a4f1-e737247758f1 service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received unexpected event network-vif-plugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with vm_state rescued and task_state None.
May 13 02:07:21.511240 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 12c32a90-8f0e-4a43-b818-c86882b54d00 due to new event <LifecycleEvent: 1778638041.5107846, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:07:21.511481 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638041.5107846, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:21.511765 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Resumed (Lifecycle Event)
May 13 02:07:21.682028 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:21.713309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:21.716755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:21.794420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:21.794590 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing instance network info cache due to event network-changed-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:21.794763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] Acquiring lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:21.794852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] Acquired lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:21.794980 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Refreshing network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:21.876368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:22.016983 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:22.020907 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:22.168375 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:22.196489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:22.307211 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:22.524523 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638042.5240402, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:22.524668 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Started (Lifecycle Event)
May 13 02:07:22.863588 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:23.030424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:23.035890 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:23.045692 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Rescuing
May 13 02:07:23.046563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:23.046689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:23.046869 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:23.083453 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updated VIF entry in instance network info cache for port cb6d0be5-c6c1-46f7-9be7-cc1a008d8241. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:23.084330 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating instance_info_cache with network_info: [{"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:23.095129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:23.095129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:23.250542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Processing event network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:23.253392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:23.253848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:23.254024 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] No waiting events found dispatching network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:23.254210 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ce174d4f-2403-4026-a3e8-a58ce3064fc9 req-f71190fb-8f99-4bf7-a2c7-ff50c9367bca service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received unexpected event network-vif-plugged-55004634-53db-4c39-a811-a8b1a6a35417 for instance with vm_state building and task_state spawning.
May 13 02:07:23.254598 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:23.258742 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:23.262509 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance spawned successfully.
May 13 02:07:23.262848 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:23.539165 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638043.5387874, c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:23.539356 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] VM Started (Lifecycle Event)
May 13 02:07:23.551925 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:23.593218 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73647b46-71ea-4dfd-a378-670ec9b5a830 req-ef56f9a4-72d7-467b-8016-370a3e9559e7 service nova] Releasing lock "refresh_cache-49cb3e10-5cb6-4107-a854-b913e5ec46b1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:23.597438 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:07:23.749656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:23.751688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:23.773939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.774188 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.774830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.775289 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.776066 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.776770 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:23.813720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:23.898810 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:23.899046 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing instance network info cache due to event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:23.899221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:23.899349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:23.899475 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:23.972055 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:24.043757 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:24.045942 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:24.167737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:24.167977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:24.170979 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updating instance_info_cache with network_info: [{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:24.173755 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:07:24.173971 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Claim successful on node np0000000663
May 13 02:07:24.252330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:07:24.283321 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Took 8.41 seconds to spawn the instance on the hypervisor.
May 13 02:07:24.283534 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:24.401692 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:24.551306 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:24.551640 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638044.5513682, c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:24.551814 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] VM Paused (Lifecycle Event)
May 13 02:07:24.682520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:24.797005 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Took 15.04 seconds to build instance.
May 13 02:07:24.878214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:24.888586 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:25.055048 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:25.062563 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638045.0619771, c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:25.062674 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] VM Resumed (Lifecycle Event)
May 13 02:07:25.105734 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updated VIF entry in instance network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:25.106170 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:25.300345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.549s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:25.308292 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:25.566642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:25.569240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:25.612542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a447040-57c2-4b21-94a8-2c605c92e49f req-c0f73bb4-ce97-41f7-9e6f-bdd4aa6ca451 service nova] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:25.886601 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-changed-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:25.886601 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Refreshing instance network info cache due to event network-changed-55004634-53db-4c39-a811-a8b1a6a35417. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:25.886601 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] Acquiring lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:25.887045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] Acquired lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:25.887359 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Refreshing network info cache for port 55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:25.972669 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:25.973640 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:26.380545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.392388 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:26.416884 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.477233 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:26.589526 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.594072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.623423 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00035110399994664476 future=<Future at 0x705c6c7e65d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:26.623568 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:26.681147 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.701226 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:26.715311 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99944468800004 future=<Future at 0x705c48736c60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:26.716418 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998347679000062 future=<Future at 0x705c48736c60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:26.717149 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998141856000075 future=<Future at 0x705c48736c60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:26.718877 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance destroyed successfully.
May 13 02:07:26.719617 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'numa_topology' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:26.870494 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:26.993561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.825s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:26.995445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.118s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:26.999873 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:07:27.004442 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:07:27.005359 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Claim successful on node np0000000663
May 13 02:07:27.037935 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updated VIF entry in instance network info cache for port 55004634-53db-4c39-a811-a8b1a6a35417. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:27.038477 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating instance_info_cache with network_info: [{"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:27.224808 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Attempting rescue
May 13 02:07:27.225523 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:07:27.229889 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:07:27.230062 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Creating image(s)
May 13 02:07:27.230842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:27.231043 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:27.231614 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:27.231816 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'trusted_certs' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:27.507950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:07:27.508945 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:07:27.509325 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:27.509569 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:27.542386 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6fb1e4f1-1e0a-4885-b209-903bcae01049 req-dd9b9954-e8c8-44b8-8c30-e414b4d5e0a9 service nova] Releasing lock "refresh_cache-c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:27.731230 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '579da0f1a16f40d1a40ce5d8bb3cb9be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069f45af679348e698b7989dd8688bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:07:27.735699 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:27.735699 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:27.741624 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:27.742531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:27.742910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:27.746818 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:27.751166 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:27.751552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:27.867866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:27.869365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:27.952400 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.rescue" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:27.952987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:27.953410 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'migration_context' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:27.967904 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:27.968296 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:27.968902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:27.969376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:27.969376 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:27.969483 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state rescuing.
May 13 02:07:27.969624 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:27.974051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:27.974851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:27.975388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:27.975710 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:27.975824 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-65dc0d68-1000-49c1-b3b2-36d5882a7793 req-a59b6385-8c36-4d8f-b6a4-cba30fc9733b service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state rescuing.
May 13 02:07:28.011911 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:07:28.457155 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:28.457294 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:28.457770 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start _get_guest_xml network_info=[{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:a0:79:ae"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:28.457936 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:28.516320 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:07:28.524795 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Successfully created port: e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:07:28.814665 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:28.815028 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:28.818126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:28.959766 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:28.970879 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:28.971828 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-2097671582', uuid='86e04c9b-9512-47f6-8849-2c171e65ea18'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:a0:79:ae"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638048.970894) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:28.975142 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:28.975142 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:28.976809 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:28.977172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:28.979185 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:28.979342 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:28.979620 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:28.981111 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:28.981450 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'vcpu_model' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:29.029514 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Booting with volume 08fd9022-14b1-4095-92f3-6b758ff6140c at /dev/vda
May 13 02:07:29.081199 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:29.098260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:07:29.122693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:29.161755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:07:29.162055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:07:29.169512 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Successfully updated port: e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:07:29.171583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:07:29.178339 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c', 'fe80::fc16:3eff:fe8e:3528', 'fe80::d068:bbff:fe8f:a813', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefa:f184', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72'] 
May 13 02:07:29.178514 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:07:29.178789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:07:29.179232 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:29.179586 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Updating existing volume attachment record: ec6479cf-f941-4601-80e8-cbe5bd60669e {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:07:29.241527 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-changed-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:29.241664 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Refreshing instance network info cache due to event network-changed-e8496464-cd34-44bd-83a0-6368bdebd4dc. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:29.242260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] Acquiring lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:29.242260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] Acquired lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:29.242260 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Refreshing network info cache for port e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:29.320536 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:29.485760 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:29.503924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2097671582',display_name='tempest-ServerRescueNegativeTestJSON-server-2097671582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-2097671582',id=28,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:04Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-t4m1vc32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:05Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=86e04c9b-9512-47f6-8849-2c171e65ea18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:a0:79:ae"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:29.504255 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:a0:79:ae"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:29.505145 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:29.505929 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:29.679948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:29.746753 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:29.813837 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:29.829884 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.836s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:29.830368 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:07:29.964491 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:30.007865 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:30.009353 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <uuid>86e04c9b-9512-47f6-8849-2c171e65ea18</uuid>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <name>instance-0000001c</name>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2097671582</nova:name>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:28</nova:creationTime>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         <nova:port uuid="a5f207e1-53af-4e40-934d-423a19436021">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="serial">86e04c9b-9512-47f6-8849-2c171e65ea18</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="uuid">86e04c9b-9512-47f6-8849-2c171e65ea18</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.rescue"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config.rescue"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:a0:79:ae"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <target dev="tapa5f207e1-53"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/console.log" append="off"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:30.009353 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:30.018845 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance destroyed successfully.
May 13 02:07:30.310485 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:30.337509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:07:30.339796 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:07:30.339796 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:30.339796 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:30.426074 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:07:30.468006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1703d08f-27e0-465f-b8b2-a1edfef7cf8e req-f25ef46c-e68d-4378-9432-b9decef0f628 service nova] Releasing lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:30.469607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquired lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:30.469847 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:30.840721 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:07:30.923399 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Successfully created port: c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:07:31.046055 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:31.269992 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:31.347234 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:07:31.350449 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:07:31.351341 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:07:31.351534 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Creating image(s)
May 13 02:07:31.351774 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:07:31.351876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Ensure instance console log exists: /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:07:31.352125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:31.352275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:31.352378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:31.462184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:31.462517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:31.471014 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Updating instance_info_cache with network_info: [{"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:31.504005 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Successfully updated port: c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:07:31.545949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:31.546086 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:31.546086 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:31.546228 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:a0:79:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:31.546634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Using config drive
May 13 02:07:31.578213 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:31.578352 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing instance network info cache due to event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:31.578670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:31.578779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:31.578916 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:31.965801 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:31.974890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Releasing lock "refresh_cache-641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:31.975184 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance network_info: |[{"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:31.976931 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Start _get_guest_xml network_info=[{"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '641f2cda-5cc8-4cd3-a1e1-7a0ec5114208', 'attached_at': '', 'detached_at': '', 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'serial': '08fd9022-14b1-4095-92f3-6b758ff6140c'}, 'attachment_id': 'ec6479cf-f941-4601-80e8-cbe5bd60669e', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:31.982560 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:31.984218 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='641f2cda-5cc8-4cd3-a1e1-7a0ec5114208'), owner=OwnerMeta(userid='579da0f1a16f40d1a40ce5d8bb3cb9be', username='tempest-ImageDependencyTests-1391203859-project-member', projectid='069f45af679348e698b7989dd8688bfa', projectname='tempest-ImageDependencyTests-1391203859'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638051.983834) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:31.985663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:31.986168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:31.987519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:31.987708 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:31.988716 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:31.989063 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:31.989284 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:31.989427 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:31.989578 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:31.989660 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:31.989747 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:31.989879 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:31.989975 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:31.990103 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:31.990287 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:31.990377 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:32.001683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:07:32.001969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:32.002237 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:32.002635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:32.002829 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:07:32.008260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:32.014976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:32.015741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:32.016233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:32.016419 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:32.017331 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:32.017724 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:32.028799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:32.028799 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:32.034375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:32.034375 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:32.042823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c] added
May 13 02:07:32.042823 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:32.042823 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:32.042823 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:32.042823 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:32.042823 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:32.042823 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:32.043228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:32.043228 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:32.043402 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:32.045679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c] added
May 13 02:07:32.045679 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:32.045679 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:32.045679 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:32.045679 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:32.045679 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:32.045679 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:32.045954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:32.045996 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:32.046208 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:32.049204 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'ec2_ids' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:32.081272 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:32.161843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:32.298940 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:32.359609 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:07:32.360718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:07:32.361044 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Creating image(s)
May 13 02:07:32.367328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:32.367328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:32.367328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:32.367607 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:32.370453 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:32.371483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:32.473180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:32.473794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:32.474201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:32.474656 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:32.479753 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:32.480223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:32.555562 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:32.555788 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'keypairs' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:32.573890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:32.574326 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:32.636400 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk 1073741824" returned: 0 in 0.062s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:32.637069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:32.637449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:32.718991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.081s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:32.719684 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:07:32.720050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:32.802230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3c0140dd-820a-4f8c-a8c6-967138b715df req-5d7b90e4-53d1-4c5c-9e04-e0ecc51a1fc7 service nova] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:32.802230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:32.802422 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:32.812375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:32.812723 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:07:32.813083 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:32.813305 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Ensure instance console log exists: /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:07:32.813798 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:32.814020 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:32.814216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:32.974301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:33.044054 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:33.046497 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:33.055987 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:33.055987 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.061381 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:33.064016 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:33.068886 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:33.068886 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.072084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.083865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.092915 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.104676 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.105072 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:33.145995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.40.100,3260]
May 13 02:07:33.145995 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.40.100,3260] successful.
May 13 02:07:33.145995 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.160367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.164605 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.50.100,3260]
May 13 02:07:33.164605 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.50.100,3260] successful.
May 13 02:07:33.164605 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.178616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.181600 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.181922 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:33.182206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:33.182206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:33.183248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] HCTL ('13', '-', '-', 0) found on session 59 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:33.183346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:33.191243 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Creating config drive at /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config.rescue
May 13 02:07:33.193807 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi4qo3evl {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.208812 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:33.209502 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:33.210947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:33.211245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:33.212118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Searching for a device in session 59 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:33.212420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:33.214341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] HCTL ('14', '-', '-', 0) found on session 60 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:33.214491 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:33.231049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Searching for a device in session 60 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:33.231263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:33.249009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi4qo3evl" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:33.373464 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:33.600574 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:33.761742 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:33.782556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:33.806078 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:33.819523 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:33.902891 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:33.928868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:33.933184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.007184 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:34.007563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:34.007563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:34.007743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:34.008918 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:34.008918 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-70a4bdc7-6b59-452b-95c9-6b66da498f51 req-8006bef8-7dcb-4594-bbbf-50d2c1ba65e7 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state rescuing.
May 13 02:07:34.019721 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:07:34.061866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:34.062139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:34.062400 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Attaching volume 13e59f5c-0cb9-405e-b950-ddfcd2be9683 to /dev/vdb
May 13 02:07:34.115436 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:34.130794 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:07:34.153249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:34.192027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:07:34.192424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:07:34.201749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:07:34.206617 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe21:38e5', 'fe80::10cb:c8ff:feb5:8a39', 'fe80::fc16:3eff:fe39:6b71', 'fe80::fc16:3eff:fe7e:25ce', 'fe80::fc16:3eff:fe5f:d273', 'fe80::28e7:63ff:fef2:1d10', 'fe80::fc16:3eff:fe30:d1cd', 'fe80::fc16:3eff:fe63:fa99', 'fe80::fc16:3eff:fe51:cc0c', 'fe80::3c3d:4cff:fefc:991c', 'fe80::fc16:3eff:fe8e:3528', 'fe80::d068:bbff:fe8f:a813', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefa:f184', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72', 'fe80::fc16:3eff:fea0:79ae'] 
May 13 02:07:34.206814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:07:34.206956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:07:34.207290 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:34.207570 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating existing volume attachment record: e8241f80-201d-4001-96a5-2628cc77a4be {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:07:34.264432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:34.266122 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance network_info: |[{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:34.267687 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start _get_guest_xml network_info=[{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:34.272647 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:34.274473 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='1fb86ac1-3a61-4254-83b6-b79416254ca5'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638054.2739713) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:34.276252 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:34.276877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:34.278260 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:34.278493 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:34.279794 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:34.280265 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:34.280465 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:34.280629 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:34.280778 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:34.280905 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:34.281036 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:34.281521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:34.281724 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:34.281923 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:34.282160 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:34.282382 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:34.299161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:34.299468 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:34.300318 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:34.301066 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:34.715282 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 86e04c9b-9512-47f6-8849-2c171e65ea18 due to new event <LifecycleEvent: 1778638054.7147613, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:07:34.715524 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638054.7147613, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:34.715791 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Resumed (Lifecycle Event)
May 13 02:07:34.721344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-dce571b2-326e-482e-a0ff-a93b64715d9f tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:34.771990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:07:34.772463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:34.772606 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:34.804794 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <uuid>1fb86ac1-3a61-4254-83b6-b79416254ca5</uuid>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <name>instance-00000021</name>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-1</nova:name>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:34</nova:creationTime>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         <nova:port uuid="c6888479-6ed8-4506-a6b4-b4627245a79f">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="serial">1fb86ac1-3a61-4254-83b6-b79416254ca5</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="uuid">1fb86ac1-3a61-4254-83b6-b79416254ca5</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:63:47:77"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <target dev="tapc6888479-6e"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/console.log" append="off"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:34.804794 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:34.807929 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Preparing to wait for external event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:34.807929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:34.807929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:34.807929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:34.808339 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:34.808339 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:34.808952 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:34.809689 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:34.812403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.812810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:34.813212 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:34.815146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.815388 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2b9f560-d10b-54bf-bd5d-d1bd4ed8cf78', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:34.817423 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.818396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:34.821606 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.824172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.824361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6888479-6e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:34.824745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6888479-6e, col_values=(('qos', UUID('295bc161-dfa1-4555-acf3-ae31c56cae17')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:34.824921 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6888479-6e, col_values=(('external_ids', {'iface-id': 'c6888479-6ed8-4506-a6b4-b4627245a79f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:47:77', 'vm-uuid': '1fb86ac1-3a61-4254-83b6-b79416254ca5'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:34.832115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:34.835612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:34.836570 np0000000663 nova-compute[98103]: INFO os_vif [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e')
May 13 02:07:35.042294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Found WWN 3300000004dd5d572 for multipath device dm-9 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:07:35.042974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:35.043204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '3300000004dd5d572', 'path': '/dev/dm-9', 'multipath_id': '3300000004dd5d572'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:35.043413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004dd5d572', 'path': '/dev/dm-9', 'multipath_id': '3300000004dd5d572'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:07:35.044417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.272s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:35.048674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:07:35.064229 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:35.066565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:35.067217 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:35.067725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:35.068310 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:35.068310 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:35.086412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:35.086412 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:35.088681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:35.088681 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:35.104428 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683] added
May 13 02:07:35.104428 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:35.104428 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:35.104428 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:35.104428 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:35.104428 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:35.104428 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:35.104750 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:35.104960 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:35.105200 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:35.110259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683] added
May 13 02:07:35.110259 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:35.110259 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:35.110259 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:35.110259 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:35.110259 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:35.110259 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:35.111401 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:35.111401 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0429(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:35.111401 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:35.222588 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:35.227987 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:35.311996 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:35.555610 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='instance-depend-image',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069f45af679348e698b7989dd8688bfa',ramdisk_id='',reservation_id='r-omghohp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1391203859',owner_user_name='tempest-ImageDependencyTests-1391203859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:29Z,user_data=None,user_id='579da0f1a16f40d1a40ce5d8bb3cb9be',uuid=641f2cda-5cc8-4cd3-a1e1-7a0ec5114208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:35.555839 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converting VIF {"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:35.556255 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:35.556729 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lazy-loading 'pci_devices' on Instance uuid 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:35.731626 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638055.7312913, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:35.731765 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Started (Lifecycle Event)
May 13 02:07:36.059663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <uuid>641f2cda-5cc8-4cd3-a1e1-7a0ec5114208</uuid>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <name>instance-00000020</name>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:name>instance-depend-image</nova:name>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:31</nova:creationTime>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:user uuid="579da0f1a16f40d1a40ce5d8bb3cb9be">tempest-ImageDependencyTests-1391203859-project-member</nova:user>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:project uuid="069f45af679348e698b7989dd8688bfa">tempest-ImageDependencyTests-1391203859</nova:project>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         <nova:port uuid="e8496464-cd34-44bd-83a0-6368bdebd4dc">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="192.168.233.111" ipVersion="4"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="serial">641f2cda-5cc8-4cd3-a1e1-7a0ec5114208</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="uuid">641f2cda-5cc8-4cd3-a1e1-7a0ec5114208</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/disk.config"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <alias name="ua-08fd9022-14b1-4095-92f3-6b758ff6140c"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-9"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <serial>08fd9022-14b1-4095-92f3-6b758ff6140c</serial>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:59:8e:1e"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <target dev="tape8496464-cd"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/console.log" append="off"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:36.059663 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Preparing to wait for external event network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='instance-depend-image',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='069f45af679348e698b7989dd8688bfa',ramdisk_id='',reservation_id='r-omghohp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1391203859',owner_user_name='tempest-ImageDependencyTests-1391203859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:29Z,user_data=None,user_id='579da0f1a16f40d1a40ce5d8bb3cb9be',uuid=641f2cda-5cc8-4cd3-a1e1-7a0ec5114208,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converting VIF {"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:36.064209 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:36.064845 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.064845 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:36.064845 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:36.066072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.068161 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eaf771f7-6d2f-58cf-af49-af06b9e98c5a', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:36.068772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.069237 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:36.077004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.082630 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.082842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8496464-cd, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:36.083315 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8496464-cd, col_values=(('qos', UUID('bd9a8fb8-b095-47c3-a16f-bbc74c8de410')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:36.083510 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8496464-cd, col_values=(('external_ids', {'iface-id': 'e8496464-cd34-44bd-83a0-6368bdebd4dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:8e:1e', 'vm-uuid': '641f2cda-5cc8-4cd3-a1e1-7a0ec5114208'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:36.091985 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.093744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:36.103635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:36.103635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:36.103635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:36.103635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:36.103635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:36.103831 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7826e3ce-b743-4f45-b4cc-d124f0c81f8d req-630fadfe-6d3f-4a38-b34a-edeea44275ca service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state rescued and task_state unrescuing.
May 13 02:07:36.107077 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:36.107959 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:36.111069 np0000000663 nova-compute[98103]: INFO os_vif [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd')
May 13 02:07:36.111689 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:36.127231 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:36.127231 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:36.137613 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:36.137613 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.146293 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.152189 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.161560 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Unrescuing
May 13 02:07:36.161770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:36.161903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:36.162205 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.174663 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.175343 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.185597 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.186683 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:36.231452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.50.100,3260]
May 13 02:07:36.231452 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.50.100,3260] successful.
May 13 02:07:36.231452 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.235383 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:36.247867 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:36.256271 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.264012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.40.100,3260]
May 13 02:07:36.264012 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.40.100,3260] successful.
May 13 02:07:36.264012 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.281739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.282244 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.282908 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:36.282908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:36.284364 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('15', '-', '-', 0) found on session 61 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:36.284478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.301574 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:36.302165 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:36.302165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:36.303532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] HCTL ('16', '-', '-', 0) found on session 62 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:36.303532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:36.313510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 61 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:36.313510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:36.333445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Searching for a device in session 62 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:36.333445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:36.363060 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:36.363268 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:36.363505 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:63:47:77, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:36.364402 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Using config drive
May 13 02:07:36.664994 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:36.746754 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 02:07:36.869752 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:37.026249 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Creating config drive at /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config
May 13 02:07:37.031691 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxt0bfpc {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:37.068957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:07:37.095638 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxt0bfpc" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:37.119137 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:37.276978 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updating instance_info_cache with network_info: [{"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:37.622466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:37.649786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:37.649946 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:37.653126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] No VIF found with MAC fa:16:3e:59:8e:1e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:37.653126 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Using config drive
May 13 02:07:37.657657 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:37.768167 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:37.780664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-86e04c9b-9512-47f6-8849-2c171e65ea18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:37.782402 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'flavor' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:37.808076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:37.814213 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:37.888310 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-31f9b312-2f06-4b31-acbd-9f7a12bf6417 req-f8f8521c-e55b-4dc8-9863-b41e694df67f service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:37.888598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-31f9b312-2f06-4b31-acbd-9f7a12bf6417 req-f8f8521c-e55b-4dc8-9863-b41e694df67f service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:37.888817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-31f9b312-2f06-4b31-acbd-9f7a12bf6417 req-f8f8521c-e55b-4dc8-9863-b41e694df67f service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:37.889005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-31f9b312-2f06-4b31-acbd-9f7a12bf6417 req-f8f8521c-e55b-4dc8-9863-b41e694df67f service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:37.889191 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-31f9b312-2f06-4b31-acbd-9f7a12bf6417 req-f8f8521c-e55b-4dc8-9863-b41e694df67f service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Processing event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:38.091978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found WWN 330000000bd63a5a8 for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:07:38.092543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:38.092543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== connect_volume: return (3319ms) {'type': 'block', 'scsi_wwn': '330000000bd63a5a8', 'path': '/dev/dm-10', 'multipath_id': '330000000bd63a5a8'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:38.092677 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bd63a5a8', 'path': '/dev/dm-10', 'multipath_id': '330000000bd63a5a8'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:07:38.100366 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:38.160278 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:38.329607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.338411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.361963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.392731 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Creating config drive at /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/disk.config
May 13 02:07:38.396746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnb_odq4c {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:38.465050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnb_odq4c" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:38.504157 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.521434 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.562689 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:38.562947 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:38.563257 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:38.563493 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:38.563629 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:38.563784 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-58688063-3417-419c-abe7-ab8e3fd5aedf req-1f0d1d74-412a-4616-b4e8-f784d53ba59f service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state rescued and task_state unrescuing.
May 13 02:07:38.604086 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Attempting to attach volume 13e59f5c-0cb9-405e-b950-ddfcd2be9683 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:07:38.605771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:   <alias name="ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683"/>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:   <serial>13e59f5c-0cb9-405e-b950-ddfcd2be9683</serial>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]: </disk>
May 13 02:07:38.605771 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:07:38.788022 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638058.787536, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:38.788691 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:38.788922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Started (Lifecycle Event)
May 13 02:07:38.795196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:38.797989 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance spawned successfully.
May 13 02:07:38.798958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:38.831229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.852359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:38.978819 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance destroyed successfully.
May 13 02:07:38.979536 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'numa_topology' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:39.288783 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.290027 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.293504 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:39.312312 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:39.317930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.317930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.317930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.317930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.321534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.323624 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:39.362612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.446193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.484426 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<86e04c9b-9512-47f6-8849-2c171e65ea18> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:07:39.574348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:39.574567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:39.575025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:39.575025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:39.575025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:39.587231 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Terminating instance
May 13 02:07:39.802312 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.815379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.829680 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:39.833580 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638059.8297393, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:39.833791 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Paused (Lifecycle Event)
May 13 02:07:39.836788 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Took 7.48 seconds to spawn the instance on the hypervisor.
May 13 02:07:39.837009 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:39.842556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:39.851409 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.002793 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:40.003029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:40.007431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:40.010037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:40.010509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:40.010702 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received unexpected event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with vm_state active and task_state None.
May 13 02:07:40.010869 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:40.011154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:40.011319 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:40.011483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:40.011626 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4f06c123-816e-4808-a9f8-1ff1ebdc7a8c req-a0915c42-213e-40ac-9d09-2d681336d498 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Processing event network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:07:40.093108 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:07:40.146803 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.187457 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.221574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.238847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.260931 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.339337 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:40.343426 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638060.34298, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:40.343656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Resumed (Lifecycle Event)
May 13 02:07:40.359486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.361952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.369299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.374855 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Took 15.62 seconds to build instance.
May 13 02:07:40.414310 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.618316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.666311 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.681898 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Instance destroyed successfully.
May 13 02:07:40.682505 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lazy-loading 'resources' on Instance uuid 71da4951-934a-4b63-b242-61f4e395eaf8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:40.699273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:40.699385 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:40.699494 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:40.699638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] No VIF found with MAC fa:16:3e:8e:35:28, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:40.763802 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.807197 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.844979 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:40.845309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:40.845535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:40.845707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:40.853856 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.856172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:40.856964 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-edcb9bd5-bc27-40b2-8653-12426eef768c req-4455700f-0cec-4a1d-878d-99e003905812 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state rescued and task_state unrescuing.
May 13 02:07:40.857728 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:40.868809 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:40.877768 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0463945b-7e65-4a07-900c-2612bbbdfff3 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.128s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:40.900362 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:07:40.906271 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:07:40.909257 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:40.911803 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance spawned successfully.
May 13 02:07:40.911935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:07:40.923860 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:40.925480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:40.925633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:40.925778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:40.926939 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:40.927320 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-88c5d4bd-3393-4ad5-b8a7-3a50a9423dc6 req-ec57eee9-8d6a-48cb-b735-7811532a62c8 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:41.017931 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.075166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.076161 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.091974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.188774 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.188774 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "address": "fa:16:3e:21:38:e5", "network": {"id": "07412172-08d2-4cac-9cdc-87cd7d5773cb", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-169793843-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap427e00b4-93", "ovs_interfaceid": "427e00b4-93dd-4fa7-9124-1214b806e8d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.188774 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.188774 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.190638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.190877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap427e00b4-93, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.193684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.225838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.227349 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.228258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce2a8eb1-a7b5-40ef-85c5-b5238e5ab398) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.229216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.230912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.260350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.266156 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:38:e5,bridge_name='br-int',has_traffic_filtering=True,id=427e00b4-93dd-4fa7-9124-1214b806e8d0,network=Network(07412172-08d2-4cac-9cdc-87cd7d5773cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap427e00b4-93')
May 13 02:07:41.267454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.267681 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.270218 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.272720 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.274802 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.274802 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ecf5ab6-0c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.275941 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.277004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.306338 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.308000 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.308252 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ba1af2e-73f1-4360-b3e6-f4b220d4c212) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.310741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.310983 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.341769 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.344329 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:6b:71,bridge_name='br-int',has_traffic_filtering=True,id=3ecf5ab6-0cce-4924-8d11-577f40b5c46f,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3ecf5ab6-0c')
May 13 02:07:41.346064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.346289 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.346893 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.347178 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.348171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.348432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e905afd-8d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.350272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.350727 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.371558 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999678753000126 future=<Future at 0x705c6c280cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.371558 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999867583999958 future=<Future at 0x705c6c280e00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.371558 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638061.3709838, 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:41.371558 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] VM Started (Lifecycle Event)
May 13 02:07:41.377152 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.379926 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.380167 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5aa984c5-abd6-45b9-a9a3-d91010426b93) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.381082 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.385742 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.405453 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.407584 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:25:ce,bridge_name='br-int',has_traffic_filtering=True,id=7e905afd-8d48-4a1d-a477-afb65fc61d17,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7e905afd-8d')
May 13 02:07:41.409192 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.410294 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.411563 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.411801 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.413917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.414185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap940bccd5-21, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.423683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.424847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.427306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.427464 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.427779 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.428501 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.428804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.429234 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:07:41.433862 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.435723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.435723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=587346ef-cc15-42ae-9a5c-890f713713cc) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.435824 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.436459 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.453924 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.457827 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:d2:73,bridge_name='br-int',has_traffic_filtering=True,id=940bccd5-2181-49f7-8df6-d4778e88d08c,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap940bccd5-21')
May 13 02:07:41.459104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.459258 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.461216 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.461216 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.461216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.461755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf226364b-93, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.467833 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.472386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.478310 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.481205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.481340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef6b1bf5-d6f6-4fd0-9920-949d49654349) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.482444 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.482697 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.494847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.502507 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:d1:cd,bridge_name='br-int',has_traffic_filtering=True,id=f226364b-9343-4b55-a3d8-f2efb251fdff,network=Network(50eba471-4a84-4986-8c80-2892a070c705),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf226364b-93')
May 13 02:07:41.502507 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.502507 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.502507 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.502507 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.503977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.504358 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0787a79e-aa, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.516861 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.516861 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.516861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64ee7e57-bab8-42f6-8b89-f610e656ac7e tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:41.517137 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.521115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.521115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1b0fe69-ad6b-4f21-a890-275a12a5cf20) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.522855 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.523749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.528132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.533387 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=0787a79e-aabd-474f-9a4b-f9578c22c59b,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0787a79e-aa')
May 13 02:07:41.535607 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-233058230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-device-tagging-server-233058230',id=22,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7aRB3/NaqZr0yYPdWhsb9+s5DGUKadCQIVPAtDdkXlgmJKzOAm/Sp0EILlwgm+H4+Gf2Ym2jtmFY614RlUzXdp7hER3We8jVDKQcv42Qmnqga3d1vKlEY7fkNsj7D9w==',key_name='tempest-keypair-1534761014',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2064c6bb5ec4e528d35b2ba7473eada',ramdisk_id='',reservation_id='r-yx5kd618',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1173439137',owner_user_name='tempest-TaggedBootDevicesTest_v242-1173439137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8201863596dd42ae8139fd90ed3eccdd',uuid=71da4951-934a-4b63-b242-61f4e395eaf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:41.537384 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converting VIF {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:41.537890 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:41.539422 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:41.541669 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.541992 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d2df2c-3a, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.543133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.543731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.545118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.546755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.546968 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd8bfc84-1f43-47ad-8a89-fa99ec5abc23) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:41.547700 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:41.549205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:41.551991 np0000000663 nova-compute[98103]: INFO os_vif [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:cc:0c,bridge_name='br-int',has_traffic_filtering=True,id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203,network=Network(b25733e3-6ab1-4c35-b373-9d1db416ae85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d2df2c-3a')
May 13 02:07:41.553627 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:41.555170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:41.555170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:41.555170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:41.555170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6553a22-915e-4fc6-9086-13a095be0c86', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:41.555170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.589707 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.590061 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:41.590061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '62')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:41.590934 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '41')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:41.592035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86', '42')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:41.593381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6984a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:41.593603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:41.593785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Flush multipath device 330000000671356b0 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:41.641869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:41.695366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:41.715971 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.001113515000042753 future=<Future at 0x705c48736c60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.715971 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.715971 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.654291567999962 future=<Future at 0x705c6c280cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.715971 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.65421914400008 future=<Future at 0x705c6c280cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:41.738389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:41.738389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:41.740172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:41.758402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:41.758402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:41.775895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.821924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.40.100,3260]
May 13 02:07:41.821924 np0000000663 nova-compute[98103]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.40.100,3260] successful.
May 13 02:07:41.821924 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.848958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.864129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.875349 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:41.883020 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:41.910985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.50.100,3260]
May 13 02:07:41.910985 np0000000663 nova-compute[98103]: Logout of [sid: 42, target: iqn.2023-03.storpool.com:os--volume-c6553a22-915e-4fc6-9086-13a095be0c86, portal: 192.168.50.100,3260] successful.
May 13 02:07:41.910985 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.935996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:41.935996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:41.935996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== disconnect_volume: return (380ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:41.935996 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:41.937635 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:41.938628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:41.941701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:41.941701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:41.941701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:41.941701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:41.944450 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Took 10.59 seconds to spawn the instance on the hypervisor.
May 13 02:07:41.944834 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.982913 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:41.983232 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:41.983232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '62')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:41.984452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '45')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:41.989736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f', '46')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:41.990744 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c698400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'): ({'sdo'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:41.990976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Removing multipathed devices sdn, sdo {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:41.991589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Flush multipath device 33000000028554f03 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:42.031367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:42.082251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:42.120414 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.121030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.121859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.121998 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.123344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] No waiting events found dispatching network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.123613 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received unexpected event network-vif-plugged-e8496464-cd34-44bd-83a0-6368bdebd4dc for instance with vm_state active and task_state None.
May 13 02:07:42.123759 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.123946 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.124189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.124346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.124490 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.124601 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.124715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.124838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.125646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.125775 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.125881 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.125980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-427e00b4-93dd-4fa7-9124-1214b806e8d0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.126123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.126257 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.126412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.126535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.126672 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.126819 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.127275 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.127540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:42.127666 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.127794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.128115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:42.128327 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.128450 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.128555 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-7e905afd-8d48-4a1d-a477-afb65fc61d17 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.128744 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.128862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.129026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.129209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.129457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.129597 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.129719 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.129900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.130037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.130416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.130585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.130705 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-940bccd5-2181-49f7-8df6-d4778e88d08c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.130776 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:42.130887 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:42.131051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:42.131274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.131478 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:42.131595 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e65aafef-3709-4743-994e-0b612488fefd req-1d7f63e7-76eb-44f3-9e66-49c892d55187 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:42.132709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:42.147648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:42.147818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:42.162679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.201674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.40.100,3260]
May 13 02:07:42.201674 np0000000663 nova-compute[98103]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.40.100,3260] successful.
May 13 02:07:42.201674 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.228642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.247566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.262029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b815e4f0-c156-4deb-adc3-f7759289ea0e tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.200s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:42.284753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.50.100,3260]
May 13 02:07:42.284753 np0000000663 nova-compute[98103]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-c3bfb2e9-1ce3-463a-8a86-5332d8158e3f, portal: 192.168.50.100,3260] successful.
May 13 02:07:42.284753 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.311710 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.311931 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:42.312024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== disconnect_volume: return (373ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:42.312175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:42.313564 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:42.313823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:42.313940 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:42.314238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:42.314501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88d2df92-fc56-4af3-8b4d-26137721f811', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:42.314636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:42.351410 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [50] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:42.352282 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '62')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:42.352282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '49')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:42.353044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811', '50')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:42.353901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6618a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'): ({'sdq'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:42.354471 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Removing multipathed devices sdq, sdp {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:42.354746 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Flush multipath device 330000000b6a0f122 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:42.385976 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:07:42.386321 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638062.3860662, 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:42.386446 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] VM Paused (Lifecycle Event)
May 13 02:07:42.390841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:42.430223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:42.470641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if SCSI volumes sdq, sdp have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:42.470877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] SCSI volumes sdq, sdp have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:42.472567 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Took 18.37 seconds to build instance.
May 13 02:07:42.474160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Checking to see if device paths {'sdq', 'sdp'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:42.489778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Device paths {'sdq', 'sdp'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:42.490016 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:42.506414 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.545506 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.40.100,3260]
May 13 02:07:42.545506 np0000000663 nova-compute[98103]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.40.100,3260] successful.
May 13 02:07:42.545506 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.568259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.583558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.626949 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.50.100,3260]
May 13 02:07:42.626949 np0000000663 nova-compute[98103]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-88d2df92-fc56-4af3-8b4d-26137721f811, portal: 192.168.50.100,3260] successful.
May 13 02:07:42.626949 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.648564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:42.648982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:42.649149 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] <== disconnect_volume: return (335ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:42.649264 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:42.652952 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Deleting instance files /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8_del
May 13 02:07:42.653634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Deletion of /opt/stack/data/nova/instances/71da4951-934a-4b63-b242-61f4e395eaf8_del complete
May 13 02:07:42.889789 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:42.895311 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638062.8940597, 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:42.895311 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] VM Resumed (Lifecycle Event)
May 13 02:07:42.975157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-560dcb76-f67a-4dc5-8b3f-800aa7beccef tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.881s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.096786 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.099113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.099970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.100557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.100821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.100866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:43.101002 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.101492 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.101702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.101876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.102039 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.102231 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-f226364b-9343-4b55-a3d8-f2efb251fdff for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:43.102410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.102563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.102730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.102819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.103025 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.103194 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state None.
May 13 02:07:43.103296 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.103476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.103636 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.103767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.103907 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.104073 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received unexpected event network-vif-plugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with vm_state active and task_state None.
May 13 02:07:43.104883 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.105041 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing instance network info cache due to event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:43.105251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:43.105535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:43.105855 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:43.127873 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.128039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.128545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.129147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.129253 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.129373 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-3ecf5ab6-0cce-4924-8d11-577f40b5c46f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:43.129462 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.129569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.129700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.129790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.129884 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.129977 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:43.130063 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:43.130232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.130349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.130441 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:43.130529 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:43.130616 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4c3f49d-2ed9-40fd-927c-63557788b7b3 req-be9a065e-2508-4532-a285-b1fd959e0f69 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-0787a79e-aabd-474f-9a4b-f9578c22c59b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:43.161402 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Took 3.07 seconds to destroy the instance on the hypervisor.
May 13 02:07:43.162607 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:07:43.162607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:07:43.162607 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:07:43.162873 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:43.193246 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:43.193463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:43.276856 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:43.399041 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:43.406952 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:43.609003 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:43.700389 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Detaching volume 13e59f5c-0cb9-405e-b950-ddfcd2be9683
May 13 02:07:43.749460 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Attempting to driver detach volume 13e59f5c-0cb9-405e-b950-ddfcd2be9683 from mountpoint /dev/vdb
May 13 02:07:43.756342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:07:43.759629 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Found disk vdb by alias ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:07:43.759629 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Attempting to detach device vdb from instance 41124908-2411-4160-b41a-ef09899a2b82 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:07:43.759629 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <alias name="ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683"/>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <serial>13e59f5c-0cb9-405e-b950-ddfcd2be9683</serial>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]: </disk>
May 13 02:07:43.759629 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:07:43.767695 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance 41124908-2411-4160-b41a-ef09899a2b82 from the persistent domain config.
May 13 02:07:43.767695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] (1/8): Attempting to detach device vdb with device alias ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683 from instance 41124908-2411-4160-b41a-ef09899a2b82 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:07:43.767695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <alias name="ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683"/>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <serial>13e59f5c-0cb9-405e-b950-ddfcd2be9683</serial>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]: </disk>
May 13 02:07:43.767695 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:07:43.909978 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 86e04c9b-9512-47f6-8849-2c171e65ea18 due to new event <LifecycleEvent: 1778638063.908385, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:07:43.909978 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638063.908385, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:43.909978 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Resumed (Lifecycle Event)
May 13 02:07:44.060976 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:44.223956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:44.224245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:44.318422 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updated VIF entry in instance network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:44.318738 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:44.331712 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683 for instance 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:07:44.367712 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:44.370638 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] Acquiring lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:44.370787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:44.370895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] Lock "71da4951-934a-4b63-b242-61f4e395eaf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:44.371012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] No waiting events found dispatching network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:44.371149 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c6d5390b-d573-494a-9370-46b5027bbc46 req-975d99ce-5b99-4c60-83c7-e6f4598af261 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-unplugged-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:44.416905 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:44.421259 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:44.728509 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:44.823660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:44.823911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:44.824037 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing instance network info cache due to event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:44.824214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:44.824295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:44.824394 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:44.926939 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638064.9260128, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:44.926939 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Started (Lifecycle Event)
May 13 02:07:45.193503 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5b1844ef-232a-4ed7-b705-8cda88beed5b req-e976b724-2a8f-414c-8ea1-15d33a5d5f90 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-deleted-427e00b4-93dd-4fa7-9124-1214b806e8d0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:45.194226 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-5b1844ef-232a-4ed7-b705-8cda88beed5b req-e976b724-2a8f-414c-8ea1-15d33a5d5f90 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Neutron deleted interface 427e00b4-93dd-4fa7-9124-1214b806e8d0; detaching it from the instance and deleting it from the info cache
May 13 02:07:45.194840 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5b1844ef-232a-4ed7-b705-8cda88beed5b req-e976b724-2a8f-414c-8ea1-15d33a5d5f90 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "address": "fa:16:3e:51:cc:0c", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d2df2c-3a", "ovs_interfaceid": "41d2df2c-3a8f-44b4-a523-cd5a3ffbe203", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:45.326319 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:45.414490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:45.437863 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:45.440273 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:07:45.698806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5b1844ef-232a-4ed7-b705-8cda88beed5b req-e976b724-2a8f-414c-8ea1-15d33a5d5f90 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Detach interface failed, port_id=427e00b4-93dd-4fa7-9124-1214b806e8d0, reason: Instance 71da4951-934a-4b63-b242-61f4e395eaf8 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:45.734448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:45.797389 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:45.943278 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638065.9428406, 41124908-2411-4160-b41a-ef09899a2b82 => ua-13e59f5c-0cb9-405e-b950-ddfcd2be9683> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:07:45.946872 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully detached device vdb from instance 41124908-2411-4160-b41a-ef09899a2b82 from the live domain config.
May 13 02:07:45.948232 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:45.948601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:45.948733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:45.949733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:45.949733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '13e59f5c-0cb9-405e-b950-ddfcd2be9683', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:45.949733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:46.001846 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683 (non-flash)
May 13 02:07:46.005505 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '62')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '62')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:46.005505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683', '61')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:46.011716 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updated VIF entry in instance network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:07:46.011716 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:46.015157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c801753a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'): ({'sdj'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:46.015706 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:46.019009 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Flush multipath device 330000000bd63a5a8 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:46.056361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:46.103028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:46.157424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:46.157424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:46.157424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:46.171782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:46.172328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:46.194213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.234804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.40.100,3260]
May 13 02:07:46.234804 np0000000663 nova-compute[98103]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.40.100,3260] successful.
May 13 02:07:46.234804 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.256923 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.271504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.305625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.50.100,3260]
May 13 02:07:46.305625 np0000000663 nova-compute[98103]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-13e59f5c-0cb9-405e-b950-ddfcd2be9683, portal: 192.168.50.100,3260] successful.
May 13 02:07:46.305625 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.325675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:46.325986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:46.326331 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] <== disconnect_volume: return (377ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:46.326446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:46.371316 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1319f2f-7bcd-403a-96e4-3785f408fbfe req-6a5167b7-3135-4b19-883b-9f7e8b573d0a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-deleted-41d2df2c-3a8f-44b4-a523-cd5a3ffbe203 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:46.371852 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-b1319f2f-7bcd-403a-96e4-3785f408fbfe req-6a5167b7-3135-4b19-883b-9f7e8b573d0a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Neutron deleted interface 41d2df2c-3a8f-44b4-a523-cd5a3ffbe203; detaching it from the instance and deleting it from the info cache
May 13 02:07:46.372282 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b1319f2f-7bcd-403a-96e4-3785f408fbfe req-6a5167b7-3135-4b19-883b-9f7e8b573d0a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "940bccd5-2181-49f7-8df6-d4778e88d08c", "address": "fa:16:3e:5f:d2:73", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap940bccd5-21", "ovs_interfaceid": "940bccd5-2181-49f7-8df6-d4778e88d08c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:46.474848 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-deleted-940bccd5-2181-49f7-8df6-d4778e88d08c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:46.475344 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Neutron deleted interface 940bccd5-2181-49f7-8df6-d4778e88d08c; detaching it from the instance and deleting it from the info cache
May 13 02:07:46.475549 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f226364b-9343-4b55-a3d8-f2efb251fdff", "address": "fa:16:3e:30:d1:cd", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf226364b-93", "ovs_interfaceid": "f226364b-9343-4b55-a3d8-f2efb251fdff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:46.514815 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:46.516774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-569b33a8-3300-473c-8ab2-5689401c4431 req-4dcee872-4fff-4817-a0e0-2b66a9961bcd service nova] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:46.548991 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:46.845191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:46.845462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:46.845717 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attaching volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 to /dev/vdb
May 13 02:07:46.886963 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1319f2f-7bcd-403a-96e4-3785f408fbfe req-6a5167b7-3135-4b19-883b-9f7e8b573d0a service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Detach interface failed, port_id=41d2df2c-3a8f-44b4-a523-cd5a3ffbe203, reason: Instance 71da4951-934a-4b63-b242-61f4e395eaf8 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:46.921252 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'flavor' on Instance uuid 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:46.922475 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:46.938434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:07:46.968902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:46.995050 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Detach interface failed, port_id=940bccd5-2181-49f7-8df6-d4778e88d08c, reason: Instance 71da4951-934a-4b63-b242-61f4e395eaf8 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:46.995853 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-deleted-f226364b-9343-4b55-a3d8-f2efb251fdff {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:46.995853 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Neutron deleted interface f226364b-9343-4b55-a3d8-f2efb251fdff; detaching it from the instance and deleting it from the info cache
May 13 02:07:46.996619 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "address": "fa:16:3e:63:fa:99", "network": {"id": "b25733e3-6ab1-4c35-b373-9d1db416ae85", "bridge": "br-int", "label": "tempest-device-tagging-net2-68653218", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0787a79e-aa", "ovs_interfaceid": "0787a79e-aabd-474f-9a4b-f9578c22c59b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:47.016174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:07:47.017252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:07:47.023032 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Took 3.86 seconds to deallocate network for instance.
May 13 02:07:47.030165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:07:47.030577 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe8e:3528', 'fe80::d068:bbff:fe8f:a813', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefa:f184', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fe59:8e1e', 'fe80::b027:5bff:fefd:9008', 'fe80::fc16:3eff:fea0:79ae'] 
May 13 02:07:47.031223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:07:47.031463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:07:47.031838 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:47.032338 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating existing volume attachment record: 319dcf63-70f5-4e4e-b002-da18e1313177 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:07:47.265628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:47.265913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:47.502390 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Detach interface failed, port_id=f226364b-9343-4b55-a3d8-f2efb251fdff, reason: Instance 71da4951-934a-4b63-b242-61f4e395eaf8 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:47.503398 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Received event network-vif-deleted-0787a79e-aabd-474f-9a4b-f9578c22c59b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:47.503398 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Neutron deleted interface 0787a79e-aabd-474f-9a4b-f9578c22c59b; detaching it from the instance and deleting it from the info cache
May 13 02:07:47.503398 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Updating instance_info_cache with network_info: [{"id": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "address": "fa:16:3e:39:6b:71", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ecf5ab6-0c", "ovs_interfaceid": "3ecf5ab6-0cce-4924-8d11-577f40b5c46f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "address": "fa:16:3e:7e:25:ce", "network": {"id": "50eba471-4a84-4986-8c80-2892a070c705", "bridge": "br-int", "label": "tempest-device-tagging-net1-935808519", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f2064c6bb5ec4e528d35b2ba7473eada", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e905afd-8d", "ovs_interfaceid": "7e905afd-8d48-4a1d-a477-afb65fc61d17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:47.605466 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:07:47.605466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:47.605466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:47.605466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:47.605466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:07:47.620436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:47.620969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:47.621615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:47.622460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:47.622652 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:47.622796 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:47.636408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:47.636408 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:47.642402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:07:47.642402 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:47.652043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547] added
May 13 02:07:47.652043 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:47.652043 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:47.652043 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:47.652043 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:47.652043 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:47.652043 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:47.652577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:47.653127 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:47.653316 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:47.657845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547] added
May 13 02:07:47.657845 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:07:47.657845 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:47.657845 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:47.657845 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:07:47.657845 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:07:47.657845 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:47.658176 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:07:47.658396 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:07:47.658396 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:07:47.768587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:07:47.929380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f9c8b71-068b-4e52-b885-5294ee67acd8 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.735s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:48.007279 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eb2474d5-882c-4be9-9320-dcb95ac199bd req-ebfb1c53-6af8-4d98-af6a-c0442f8ac530 service nova] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Detach interface failed, port_id=0787a79e-aabd-474f-9a4b-f9578c22c59b, reason: Instance 71da4951-934a-4b63-b242-61f4e395eaf8 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:48.344294 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:48.344561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:48.347853 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:07:48.348034 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Claim successful on node np0000000663
May 13 02:07:48.606181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:48.606721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:48.606721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:48.606721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:48.606721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:48.608736 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Terminating instance
May 13 02:07:48.654118 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:48.659442 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:48.670496 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:48.670496 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:48.676698 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:48.676698 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.688653 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.694244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.708033 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.720526 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:48.746865 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Took 1.72 seconds to detach 3 volumes for instance.
May 13 02:07:48.755233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.50.100,3260]
May 13 02:07:48.755233 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.50.100,3260] successful.
May 13 02:07:48.755233 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.775686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.40.100,3260]
May 13 02:07:48.775686 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.40.100,3260] successful.
May 13 02:07:48.775686 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.776309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.795205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.795889 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.796305 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:48.796305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:48.796620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:48.797760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('7', '-', '-', 0) found on session 63 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:48.797869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.814949 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:48.815348 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:48.815644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:48.815848 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:48.816842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('8', '-', '-', 0) found on session 64 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:48.816942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:48.826610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 63 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:48.826610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:48.846927 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 64 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:48.847552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:48.938029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:48.938313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:48.938549 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:48.938716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:48.938880 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:48.942836 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Terminating instance
May 13 02:07:49.112059 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:07:49.148509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.156665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.181379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.187337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.216587 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.219589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:49.220158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:49.220397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:49.220572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:49.220752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:49.224820 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Terminating instance
May 13 02:07:49.254506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:49.346448 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:49.346863 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:49.347057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:49.347257 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:49.347423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] No waiting events found dispatching network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:49.347596 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-461183c6-cca1-4126-b838-221488b482ff req-3a6f7864-2031-434e-8d33-6cbe3ec1fb45 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:49.448368 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:07:49.459957 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99960607800017 future=<Future at 0x705c801c71a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:49.469651 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Instance destroyed successfully.
May 13 02:07:49.470449 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lazy-loading 'resources' on Instance uuid 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:49.483833 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.519912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.527741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.567361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.572664 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.622853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:07:49.733720 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:07:49.774303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.781042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.806828 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999678152999877 future=<Future at 0x705c6c77ef90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:49.808966 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Instance destroyed successfully.
May 13 02:07:49.808966 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lazy-loading 'resources' on Instance uuid 41124908-2411-4160-b41a-ef09899a2b82 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:49.823281 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.957779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.975936 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='instance-depend-image',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:41Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='069f45af679348e698b7989dd8688bfa',ramdisk_id='',reservation_id='r-omghohp8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1391203859',owner_user_name='tempest-ImageDependencyTests-1391203859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:07:42Z,user_data=None,user_id='579da0f1a16f40d1a40ce5d8bb3cb9be',uuid=641f2cda-5cc8-4cd3-a1e1-7a0ec5114208,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:49.975936 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converting VIF {"id": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "address": "fa:16:3e:59:8e:1e", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8496464-cd", "ovs_interfaceid": "e8496464-cd34-44bd-83a0-6368bdebd4dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:49.975936 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:49.975936 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:49.977515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.978812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8496464-cd, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:49.980123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.981229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:49.994549 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.995797 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.996028 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd9a8fb8-b095-47c3-a16f-bbc74c8de410) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:49.996752 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:49.997442 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:50.010491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.013490 np0000000663 nova-compute[98103]: INFO os_vif [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:8e:1e,bridge_name='br-int',has_traffic_filtering=True,id=e8496464-cd34-44bd-83a0-6368bdebd4dc,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8496464-cd')
May 13 02:07:50.024259 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:50.025107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:50.025107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:50.093890 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999650269999847 future=<Future at 0x705c6c28d100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:50.097238 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Instance destroyed successfully.
May 13 02:07:50.097877 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'resources' on Instance uuid 81d1e9b6-0f42-49d5-95ee-01273edb45c7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:50.312222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-483433836',display_name='tempest-AttachVolumeNegativeTest-server-483433836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumenegativetest-server-483433836',id=27,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEs3Sg8xPmq4gdwB1H0CArifHNxheAZdeMJ5PDO9B/tI2v2iiiWL6LBQf9YslIZbYMCuJNs4lXfHfhKHPRoFuHE/sH8mPjO+7p3j2acoFftUaA1ElWLvQEwHV0pSGuMIQ==',key_name='tempest-keypair-2017501616',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:51Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b9a7e74db544084a4907abd0f241e8b',ramdisk_id='',reservation_id='r-r982nrcj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-603660763',owner_user_name='tempest-AttachVolumeNegativeTest-603660763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ff4dd8b153c4ae98a37ba022bb538c6',uuid=41124908-2411-4160-b41a-ef09899a2b82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:50.312644 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converting VIF {"id": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "address": "fa:16:3e:8e:35:28", "network": {"id": "db6c8858-45bb-429f-b8bb-04847f26eaaf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1313527979-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4b9a7e74db544084a4907abd0f241e8b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap760a1107-1c", "ovs_interfaceid": "760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:50.313401 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:50.313717 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:50.315652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.315652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap760a1107-1c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:50.317033 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.318583 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:50.324795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.326177 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.326458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00c9985e-cd50-4b51-b8bc-16815fa8c5ce) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:50.327947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.328634 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:50.334684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.339465 np0000000663 nova-compute[98103]: INFO os_vif [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:35:28,bridge_name='br-int',has_traffic_filtering=True,id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d,network=Network(db6c8858-45bb-429f-b8bb-04847f26eaaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap760a1107-1c')
May 13 02:07:50.339851 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Deleting instance files /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82_del
May 13 02:07:50.340854 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Deletion of /opt/stack/data/nova/instances/41124908-2411-4160-b41a-ef09899a2b82_del complete
May 13 02:07:50.355544 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:50.356024 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:50.417265 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.603315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-429451115',display_name='tempest-ServerActionsTestOtherA-server-429451115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-429451115',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:07Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-yqtx0aen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=81d1e9b6-0f42-49d5-95ee-01273edb45c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:07:50.603584 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "address": "fa:16:3e:fa:f1:84", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap86a2acdd-98", "ovs_interfaceid": "86a2acdd-98ba-4f77-83d6-b7f93793b27f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:50.604293 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:50.604600 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:07:50.606874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.606874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86a2acdd-98, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:50.608936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.610348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:50.611321 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.611598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f700995-e2f3-4c5e-9aea-fddc3718a3f4) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:50.614109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:50.615037 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:50.617234 np0000000663 nova-compute[98103]: INFO os_vif [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:f1:84,bridge_name='br-int',has_traffic_filtering=True,id=86a2acdd-98ba-4f77-83d6-b7f93793b27f,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86a2acdd-98')
May 13 02:07:50.618737 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:07:50.619103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:50.619260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:50.639282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 330000000f04cf47c for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:07:50.639762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:50.639762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:50.639874 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:07:50.640492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.616s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:50.641044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '08fd9022-14b1-4095-92f3-6b758ff6140c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:50.641442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:50.653081 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:50.676014 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [60] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:50.679191 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:50.679191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '59')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:50.680673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c', '60')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:50.682046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c269e40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:50.682741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:50.683256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Flush multipath device 3300000004dd5d572 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:50.717813 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:50.768035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:50.808535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:50.808535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:50.809809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:50.824150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:50.824150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:50.839023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.853623 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 02:07:50.854458 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:07:50.854903 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:07:50.855086 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:07:50.855437 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:50.858967 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:50.884186 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.40.100,3260]
May 13 02:07:50.884186 np0000000663 nova-compute[98103]: Logout of [sid: 59, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.40.100,3260] successful.
May 13 02:07:50.884186 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.918070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.930981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.975386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.50.100,3260]
May 13 02:07:50.975386 np0000000663 nova-compute[98103]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-08fd9022-14b1-4095-92f3-6b758ff6140c, portal: 192.168.50.100,3260] successful.
May 13 02:07:50.975386 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.994788 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:50.998218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:50.998218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] <== disconnect_volume: return (970ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:50.998218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:50.998218 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Deleting instance files /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208_del
May 13 02:07:50.998218 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Deletion of /opt/stack/data/nova/instances/641f2cda-5cc8-4cd3-a1e1-7a0ec5114208_del complete
May 13 02:07:51.003855 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:51.006463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.387s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:51.008121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c84d870e-7c67-46ef-b733-6926795384a7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:07:51.008321 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:51.043353 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:07:51.043353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '56')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:51.044022 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7', '55')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:07:51.045249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c88284d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:07:51.045937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:07:51.045937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Flush multipath device 330000000ee111f48 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:07:51.098975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:51.143413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:07:51.158084 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attempting to attach volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:07:51.165145 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]: </disk>
May 13 02:07:51.165145 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:07:51.187347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:07:51.187539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:07:51.188567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:07:51.202708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:07:51.202708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:07:51.218730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.257591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260]
May 13 02:07:51.257591 np0000000663 nova-compute[98103]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.40.100,3260] successful.
May 13 02:07:51.257591 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.278335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.293638 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.327662 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260]
May 13 02:07:51.327662 np0000000663 nova-compute[98103]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-c84d870e-7c67-46ef-b733-6926795384a7, portal: 192.168.50.100,3260] successful.
May 13 02:07:51.327662 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] <== disconnect_volume: return (739ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Deleting instance files /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7_del
May 13 02:07:51.361295 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Deletion of /opt/stack/data/nova/instances/81d1e9b6-0f42-49d5-95ee-01273edb45c7_del complete
May 13 02:07:51.373253 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.028s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.374272 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:07:51.376321 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.122s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.522717 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Took 2.41 seconds to destroy the instance on the hypervisor.
May 13 02:07:51.523729 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:07:51.523950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:07:51.524130 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:07:51.524503 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:51.560405 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.560758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Acquiring lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:51.560989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.561209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.561392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] No waiting events found dispatching network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:51.561557 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-unplugged-e8496464-cd34-44bd-83a0-6368bdebd4dc for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:51.561736 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.561922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:51.562140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.562830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.562970 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] No waiting events found dispatching network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:51.563217 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:51.563370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.563553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Acquiring lock "41124908-2411-4160-b41a-ef09899a2b82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:51.564104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.564104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "41124908-2411-4160-b41a-ef09899a2b82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.564257 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] No waiting events found dispatching network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:51.564540 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-unplugged-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:51.564720 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.564924 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:51.565149 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.565262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.565414 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:51.565551 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:51.565697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.565844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Acquiring lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:51.565997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:51.566419 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:51.566419 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] No waiting events found dispatching network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:07:51.566419 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8e9329b-02f1-43f8-b582-21eec9413398 req-16c4cfa8-2648-4880-9f55-9aa7957ed361 service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-unplugged-86a2acdd-98ba-4f77-83d6-b7f93793b27f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:07:51.597915 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c699caac-be0c-4e8b-bb50-b6f35961ec0c req-bc68e30e-277e-4436-b6dc-136bf5b48ad2 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Received event network-vif-deleted-760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:51.598846 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-c699caac-be0c-4e8b-bb50-b6f35961ec0c req-bc68e30e-277e-4436-b6dc-136bf5b48ad2 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Neutron deleted interface 760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d; detaching it from the instance and deleting it from the info cache
May 13 02:07:51.598846 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c699caac-be0c-4e8b-bb50-b6f35961ec0c req-bc68e30e-277e-4436-b6dc-136bf5b48ad2 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:51.644513 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:51.868431 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Took 2.13 seconds to destroy the instance on the hypervisor.
May 13 02:07:51.869106 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:07:51.872121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:07:51.872121 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:07:51.872121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:51.883121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:07:51.883121 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:07:51.883121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:51.883121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:52.022051 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:52.023765 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:52.064972 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1cf7b3eb74a47aca33e0d7fc78c7b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c88a2c430e64df18a80e42983f49a4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:07:52.106574 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c699caac-be0c-4e8b-bb50-b6f35961ec0c req-bc68e30e-277e-4436-b6dc-136bf5b48ad2 service nova] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Detach interface failed, port_id=760a1107-1c6f-4f35-b4db-7d6ad4ce8b5d, reason: Instance 41124908-2411-4160-b41a-ef09899a2b82 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:07:52.382410 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:07:52.493283 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:52.493513 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:52.510717 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:52.527751 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Took 1.67 seconds to deallocate network for instance.
May 13 02:07:52.837946 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Successfully created port: 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:07:52.872483 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:52.872636 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:52.872749 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:52.872920 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:53:33:ed, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:52.890113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:07:52.997298 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:53.013175 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Took 1.49 seconds to deallocate network for instance.
May 13 02:07:53.042678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:53.096362 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:53.507228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.130s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:53.508838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.464s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:53.597990 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Deleted allocations for instance 71da4951-934a-4b63-b242-61f4e395eaf8
May 13 02:07:53.600833 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Took 1.73 seconds to deallocate network for instance.
May 13 02:07:53.609007 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Successfully updated port: 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:07:53.628563 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Took 0.61 seconds to detach 1 volumes for instance.
May 13 02:07:53.631328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Deleting volume: 08fd9022-14b1-4095-92f3-6b758ff6140c {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:07:53.670743 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-34390a3f-51d0-49f8-af8b-cb7af482dd07 req-03aa0e3c-de2a-46f8-ad49-50aca42f41e1 service nova] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Received event network-vif-deleted-e8496464-cd34-44bd-83a0-6368bdebd4dc {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:53.699579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2763253c-3a12-42ca-8440-c69c842f31c8 req-556e83eb-ded1-45ec-b0a9-42f9412e023b service nova] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Received event network-vif-deleted-86a2acdd-98ba-4f77-83d6-b7f93793b27f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:53.705724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-changed-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:07:53.706144 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing instance network info cache due to event network-changed-533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:07:53.706515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:53.706787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:53.710389 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:07:53.904190 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:07:53.909956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:07:53.911146 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Creating image(s)
May 13 02:07:53.911889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:53.912146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:53.912832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:53.913544 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:53.923634 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:53.925857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:54.078695 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.153s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:54.080581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:54.081926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:54.081926 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:54.087588 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:07:54.088130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:54.124250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:07:54.197161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:54.199162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:54.234454 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:54.242134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:54.285673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk 1073741824" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:54.286155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:54.286470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:54.333219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:54.333667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:54.419177 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:54.423270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.136s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:54.423480 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:07:54.423785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:54.497436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eb37a0e7-a878-451d-b00a-ab39a4e5b465 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.652s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:54.503235 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Took 0.90 seconds to detach 1 volumes for instance.
May 13 02:07:54.513637 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Deleting volume: c84d870e-7c67-46ef-b733-6926795384a7 {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:07:54.574889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:54.575637 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Cannot resize image /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:07:54.575986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:07:54.576201 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Ensure instance console log exists: /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:07:54.576489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:54.577161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:54.577161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:54.637396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-44486ac0-e86f-4155-a5f8-162fe5f5b9ce tempest-TaggedBootDevicesTest_v242-1173439137 tempest-TaggedBootDevicesTest_v242-1173439137-project-member] Lock "71da4951-934a-4b63-b242-61f4e395eaf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.063s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:54.672400 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:54.775708 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:54.775871 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:54.846602 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:55.102872 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:55.177206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fb6a3f6-f650-42da-819c-b8876c91c344 req-4dc2f258-d677-41fa-9371-a50977315562 service nova] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:55.177206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:07:55.177206 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:07:55.279903 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:55.422525 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:55.612028 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:55.756695 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:07:55.788021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.281s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:55.790271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.546s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:55.843900 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.844356 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.844644 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.844891 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.845141 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.845441 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.845723 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.846297 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.846297 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:07:55.846565 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:07:55.855112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:55.902510 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Deleted allocations for instance 41124908-2411-4160-b41a-ef09899a2b82
May 13 02:07:56.009429 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:56.203874 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:07:56.353517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:56.373793 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.003405887999861079 future=<Future at 0x705c6c280cb0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.378744 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.381260 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.010243065000167917 future=<Future at 0x705c6c280e00 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.381603 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.01060440700007348 future=<Future at 0x705c6c280e00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.381603 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.381920 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.077756272999977 future=<Future at 0x705c801c71a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.381920 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.077666417000046 future=<Future at 0x705c801c71a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:07:56.382858 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638061.3707883, 71da4951-934a-4b63-b242-61f4e395eaf8 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:07:56.382858 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] VM Stopped (Lifecycle Event)
May 13 02:07:56.641654 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:07:56.641654 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:07:56.706208 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:07:56.706581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance network_info: |[{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:07:56.708466 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start _get_guest_xml network_info=[{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:07:56.713217 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:07:56.714911 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-227258032', uuid='b6762a47-e412-4488-a878-420fb31d8b76'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638076.71444) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:07:56.718196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:07:56.718661 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:07:56.719943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:07:56.719943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:07:56.721431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:07:56.722117 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:07:56.722354 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:07:56.722487 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:07:56.722629 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:07:56.722785 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:07:56.722941 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:07:56.723220 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:07:56.723351 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:07:56.723502 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:07:56.723721 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:07:56.723808 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:07:56.751210 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-227258032',display_name='tempest-ServerRescueNegativeTestJSON-server-227258032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-227258032',id=34,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEBKHNXwFCXl4plP0qcZWYfEK8yfMpHcT9D/zE/pNWrpGxnBWvXitYaZCdQYPOltZRyszM1VcrRh+y6pRi0JKKJ6F1KjcjInD3jSfCBoool3+NRmmkxSJeCbr2zr7j1yQ==',key_name='tempest-keypair-316346649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-e3kj90ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=b6762a47-e412-4488-a878-420fb31d8b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:07:56.751395 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:56.752174 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:56.753028 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:56.886446 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 71da4951-934a-4b63-b242-61f4e395eaf8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:07:56.915039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cc73e6ee-8dfc-4243-a307-2b25c7c79d4c tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Lock "41124908-2411-4160-b41a-ef09899a2b82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.977s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:56.917368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:56.917368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:56.917515 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attaching volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 to /dev/vdb
May 13 02:07:56.990750 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:57.005462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:07:57.044807 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:57.102419 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:07:57.102419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:07:57.124188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:07:57.124188 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe02:baa6', 'fe80::203e:d2ff:fecb:ba84', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fea0:79ae'] 
May 13 02:07:57.124703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:07:57.125008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:07:57.127603 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:57.127887 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating existing volume attachment record: 3a704557-b773-4479-8dc7-7815b5c77456 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:07:57.147679 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:07:57.167207 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.258112 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] End _get_guest_xml xml=<domain type="qemu">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <uuid>b6762a47-e412-4488-a878-420fb31d8b76</uuid>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <name>instance-00000022</name>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-227258032</nova:name>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:07:56</nova:creationTime>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         <nova:port uuid="533aa486-0d6c-4235-91bf-8e888684516d">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <system>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="serial">b6762a47-e412-4488-a878-420fb31d8b76</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="uuid">b6762a47-e412-4488-a878-420fb31d8b76</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </system>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <os>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </os>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <features>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </features>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   <devices>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </disk>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:de:c2:09"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <target dev="tap533aa486-0d"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </interface>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/console.log" append="off"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </serial>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <video>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </video>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </rng>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:   </devices>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]: </domain>
May 13 02:07:57.258112 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Preparing to wait for external event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-227258032',display_name='tempest-ServerRescueNegativeTestJSON-server-227258032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-227258032',id=34,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEBKHNXwFCXl4plP0qcZWYfEK8yfMpHcT9D/zE/pNWrpGxnBWvXitYaZCdQYPOltZRyszM1VcrRh+y6pRi0JKKJ6F1KjcjInD3jSfCBoool3+NRmmkxSJeCbr2zr7j1yQ==',key_name='tempest-keypair-316346649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-e3kj90ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=b6762a47-e412-4488-a878-420fb31d8b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:07:57.260927 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:07:57.261328 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:07:57.261328 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:07:57.262338 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.263614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:57.264074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:07:57.264895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.265176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b27654a-9a44-5ca7-be73-1e5694461366', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:57.265952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.267745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:57.267745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.270365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.270537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap533aa486-0d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:57.271195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap533aa486-0d, col_values=(('qos', UUID('6e3235a7-101f-4fbc-99f8-ee5c1202d922')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:57.271295 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap533aa486-0d, col_values=(('external_ids', {'iface-id': '533aa486-0d6c-4235-91bf-8e888684516d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:c2:09', 'vm-uuid': 'b6762a47-e412-4488-a878-420fb31d8b76'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:07:57.272359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.273930 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:07:57.280068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:07:57.281259 np0000000663 nova-compute[98103]: INFO os_vif [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d')
May 13 02:07:57.658290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.870s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:57.660591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.556s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:57.662355 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:57.664101 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.309s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:07:57.664343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:57.664524 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:07:57.693790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:07:57.694619 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:07:57.694813 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:57.695945 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:57.696174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:07:57.712431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:57.713574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:07:57.714413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:57.714868 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:07:57.718193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:07:57.718538 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:57.729570 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:57.729570 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:07:57.736835 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:07:57.736835 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:57.750309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:57.752493 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:07:57.754175 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Deleted allocations for instance 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208
May 13 02:07:57.771384 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Deleted allocations for instance 81d1e9b6-0f42-49d5-95ee-01273edb45c7
May 13 02:07:57.774507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.774507 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.774507 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.774507 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.774507 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:57.774736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.774736 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.774736 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.774736 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.774736 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:57.775282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:57.775681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:57.776362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.776362 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.776362 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.776362 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.776362 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:07:57.776539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.776539 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:07:57.776539 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.776539 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:07:57.776539 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:07:57.776688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:57.777081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:07:57.778109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('7', '0', '0', 0) found on session 63 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:57.778301 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:57.779013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('8', '0', '0', 0) found on session 64 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:07:57.779013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:07:57.794061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 63 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:57.794507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:57.796574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 64 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:07:57.796574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:07:58.714985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:07:58.729014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:58.769768 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b9022c01-da09-4307-b16c-07cd7f6c920f tempest-ImageDependencyTests-1391203859 tempest-ImageDependencyTests-1391203859-project-member] Lock "641f2cda-5cc8-4cd3-a1e1-7a0ec5114208" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.163s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:58.783106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24bea5c5-d555-47a2-896d-1fb2cf36d699 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "81d1e9b6-0f42-49d5-95ee-01273edb45c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.563s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:07:58.816327 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:58.816515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:07:58.816702 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:de:c2:09, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:07:58.817633 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Using config drive
May 13 02:07:58.855922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:58.855922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:58.955147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:58.955147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.051144 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.051144 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.146727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.151941 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.259275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.261295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.329264 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:07:59.354700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.358343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.456357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.456943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.516960 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Creating config drive at /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config
May 13 02:07:59.526047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpue4rh81c {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.570125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.574749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.595073 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpue4rh81c" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.704604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.707857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.745121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 330000000f04cf47c for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:07:59.745956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.050s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:07:59.746798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (2051ms) {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:07:59.746798 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:07:59.756363 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:07:59.815917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.821279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:07:59.955691 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:07:59.958154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.063443 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.071754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.160086 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.161823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.195487 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.201935 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.202608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.262912 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attempting to attach volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:08:00.268959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]: </disk>
May 13 02:08:00.268959 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:08:00.302151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.319856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.325718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.347323 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.392323 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:00.392617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:00.392881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:00.393106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:00.393262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:00.398816 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Terminating instance
May 13 02:08:00.427251 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-96d3fbf8-5601-4725-8614-95e86c8210be req-e175bf95-ab52-4e46-846f-b8e256b81598 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:00.429351 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-96d3fbf8-5601-4725-8614-95e86c8210be req-e175bf95-ab52-4e46-846f-b8e256b81598 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:00.429810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.429985 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-96d3fbf8-5601-4725-8614-95e86c8210be req-e175bf95-ab52-4e46-846f-b8e256b81598 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:00.430154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-96d3fbf8-5601-4725-8614-95e86c8210be req-e175bf95-ab52-4e46-846f-b8e256b81598 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:00.436398 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-96d3fbf8-5601-4725-8614-95e86c8210be req-e175bf95-ab52-4e46-846f-b8e256b81598 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Processing event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:00.445506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.449356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.547405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.551391 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.648061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.649577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.739721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.739721 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:08:00.753324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:08:00.755913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.842651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.843320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.906509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:08:00.934339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.937722 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.949263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:00.955803 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:00.957016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:00.979339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:00.996770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.011607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:01.014630 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=11371MB free_disk=74.24794387817383GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:08:01.014630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:01.014630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:01.228131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:01.228131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:01.228131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:01.228131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:01.228131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] No waiting events found dispatching network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:01.229160 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f00e6753-3e75-436f-80a0-a5a088092322 req-5a36fe66-8251-42cb-9a2d-56c7b60d23dd service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:01.277697 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999691547000111 future=<Future at 0x705c6c665010 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:01.281782 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Instance destroyed successfully.
May 13 02:08:01.282468 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lazy-loading 'resources' on Instance uuid ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:01.296847 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638081.2964735, b6762a47-e412-4488-a878-420fb31d8b76 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:01.297635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:01.297818 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Started (Lifecycle Event)
May 13 02:08:01.305829 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:01.313816 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance spawned successfully.
May 13 02:08:01.314515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:01.786789 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-937037352',display_name='tempest-ServerActionsTestOtherA-server-937037352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serveractionstestothera-server-937037352',id=9,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGTusyoa/6m6tKnByuCjoyPi5wjOuDlw1mGq9Ah8UWkPofvaWZf15kSdW5dih0iRV5hYW4FgeE3Io5g8OWyXeSMuiahFGmVGZYBXmIkEcfBST7lbV7hZoGzpyc5tqNqCA==',key_name='tempest-keypair-998796082',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:03:15Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeca98c5180647b2910bdd1f13ac4196',ramdisk_id='',reservation_id='r-vwy6ymr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1936571963',owner_user_name='tempest-ServerActionsTestOtherA-1936571963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33425a40c04d488bba6393ace2394be5',uuid=ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:08:01.787340 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converting VIF {"id": "89932177-53f0-4903-bef2-895d215d7444", "address": "fa:16:3e:02:ba:a6", "network": {"id": "d98d0606-aa11-459a-8be9-1adc5f707ab9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-321100948-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "eeca98c5180647b2910bdd1f13ac4196", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap89932177-53", "ovs_interfaceid": "89932177-53f0-4903-bef2-895d215d7444", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:01.787602 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:01.787823 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:08:01.789231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.789535 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89932177-53, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:01.790955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.792896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:01.793608 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.793746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10b71923-8a65-41cc-8d39-74e77a37deb2) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:01.794264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.795112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:01.795509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:01.799836 np0000000663 nova-compute[98103]: INFO os_vif [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:ba:a6,bridge_name='br-int',has_traffic_filtering=True,id=89932177-53f0-4903-bef2-895d215d7444,network=Network(d98d0606-aa11-459a-8be9-1adc5f707ab9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89932177-53')
May 13 02:08:01.800904 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:01.801491 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Deleting instance files /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5_del
May 13 02:08:01.802416 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Deletion of /opt/stack/data/nova/instances/ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5_del complete
May 13 02:08:01.806390 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:01.824724 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:01.824724 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:01.824856 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:01.825085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:01.825431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:01.825721 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:02.014168 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:02.014274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:02.014368 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:02.014540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:63:47:77, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:02.118164 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118164 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118392 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118392 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118549 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 86e04c9b-9512-47f6-8849-2c171e65ea18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118619 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 12c32a90-8f0e-4a43-b818-c86882b54d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118757 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.118931 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.119072 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.119232 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b6762a47-e412-4488-a878-420fb31d8b76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:08:02.119469 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:08:02.119609 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:08:01 up 31 min,  2 users,  load average: 9.32, 6.79, 3.51\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_deleting': '1', 'num_os_type_None': '10', 'num_proj_eeca98c5180647b2910bdd1f13ac4196': '1', 'io_workload': '1', 'num_task_None': '8', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '5', 'num_proj_2c88a2c430e64df18a80e42983f49a4b': '3', 'num_vm_rescued': '1', 'num_proj_ec9eeb94f4b745e38a31c2a39079ce9c': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:08:02.311348 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:02.312235 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638082.3119214, b6762a47-e412-4488-a878-420fb31d8b76 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:02.312438 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Paused (Lifecycle Event)
May 13 02:08:02.315102 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:08:02.315648 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:08:02.315948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:08:02.316108 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:08:02.316448 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:02.335430 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Took 8.43 seconds to spawn the instance on the hypervisor.
May 13 02:08:02.335430 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:02.427916 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:02.732831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:02.733154 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:02.765652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:02.820157 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:02.827843 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638082.8272653, b6762a47-e412-4488-a878-420fb31d8b76 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:02.828051 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Resumed (Lifecycle Event)
May 13 02:08:02.847355 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Took 14.57 seconds to build instance.
May 13 02:08:03.000895 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:03.001485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:03.002165 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:03.002339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:03.002502 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:03.002676 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state active and task_state None.
May 13 02:08:03.002831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-deleted-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:03.003006 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Neutron deleted interface 89932177-53f0-4903-bef2-895d215d7444; detaching it from the instance and deleting it from the info cache
May 13 02:08:03.003180 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:03.238139 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:03.258386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:03.330185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:03.334595 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:03.335949 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:03.341528 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:03.349057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.083s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:03.526242 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0c499878-3d71-44ac-b131-0a35753bdbed req-f500c11d-25c8-4a25-9ec7-c38d3d4f4d09 service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Detach interface failed, port_id=89932177-53f0-4903-bef2-895d215d7444, reason: Instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:08:03.579369 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:03.580354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] Acquiring lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:03.580627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:03.580707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:03.580847 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] No waiting events found dispatching network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:03.581023 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce988522-e30c-4731-9339-42143356f8a0 req-585fdcc9-b0a1-40dd-91fc-483d7dae67eb service nova] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Received event network-vif-unplugged-89932177-53f0-4903-bef2-895d215d7444 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:03.586667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d30ad741-d076-4330-af50-17c641d0186c tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.669s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:03.745386 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:08:03.745597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:03.745948 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:08:03.840799 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Took 1.52 seconds to deallocate network for instance.
May 13 02:08:04.349893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:04.352318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:04.464450 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0035411599999406462 future=<Future at 0x705c801c71a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.464450 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5209492a-c014-43a9-8618-520e1d19aaab None None] Emitting event <LifecycleEvent: 1778638069.4594278, 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:04.464450 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.464450 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.3420625740000105 future=<Future at 0x705c6c77ef90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.464450 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.34195049499999186 future=<Future at 0x705c6c77ef90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.464703 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5209492a-c014-43a9-8618-520e1d19aaab None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] VM Stopped (Lifecycle Event)
May 13 02:08:04.787407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:04.789224 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:04.808110 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0018682019999687327 future=<Future at 0x705c6c77ef90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.808222 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.808344 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.2851485319999938 future=<Future at 0x705c6c28d100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.808433 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.2850416429998859 future=<Future at 0x705c6c28d100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:04.809411 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638069.8061123, 41124908-2411-4160-b41a-ef09899a2b82 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:04.809592 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] VM Stopped (Lifecycle Event)
May 13 02:08:04.970239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5209492a-c014-43a9-8618-520e1d19aaab None None] [instance: 641f2cda-5cc8-4cd3-a1e1-7a0ec5114208] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:05.050115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:05.050433 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:05.093986 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004208950001611811 future=<Future at 0x705c6c28d100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:05.095337 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Emitting event <LifecycleEvent: 1778638070.0933506, 81d1e9b6-0f42-49d5-95ee-01273edb45c7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:05.095337 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:05.095337 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] VM Stopped (Lifecycle Event)
May 13 02:08:05.097513 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.179758310000125 future=<Future at 0x705c6c665010 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:05.097699 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.179053981000152 future=<Future at 0x705c6c665010 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:05.100466 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-changed-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:05.100661 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing instance network info cache due to event network-changed-533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:05.100773 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:05.100861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:05.100974 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:05.297190 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lazy-loading 'flavor' on Instance uuid c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:05.315072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 41124908-2411-4160-b41a-ef09899a2b82] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:05.428149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:05.553749 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:05.599557 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-64b739bc-3f36-4b34-8538-4f05c7af86e3 tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: 81d1e9b6-0f42-49d5-95ee-01273edb45c7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:05.605228 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:05.800999 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Ignoring supplied device name: /dev/vdb
May 13 02:08:06.025565 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:06.063291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.710s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:06.147607 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Deleted allocations for instance ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5
May 13 02:08:06.233840 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:06.239469 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updated VIF entry in instance network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:08:06.240251 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:06.291764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:06.310830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.522s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:06.562529 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Stashing vm_state: active {{(pid=98103) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 02:08:06.743013 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-143d412e-5cf3-4d13-9e93-1291a374c9ed req-2f17fba6-a65a-4ecd-92ba-952bf807856f service nova] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:06.794571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:07.145122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:07.145618 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:07.159264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30110ee1-b21b-4667-aa07-8eee14a6c73c tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Lock "ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.766s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:07.408755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:07.410309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:07.410309 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Attaching volume 4bf2cece-25a7-425e-a7fc-139194b34f23 to /dev/vdb
May 13 02:08:07.489852 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:07.504041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:08:07.534356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:07.598070 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:08:07.598798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:08:07.611158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:08:07.613336 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fede:c209'] 
May 13 02:08:07.613336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:08:07.613778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:08:07.613851 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:07.614540 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating existing volume attachment record: b5180d65-af49-48b8-a91f-b2723f6c4dd4 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:08:07.657460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:07.657460 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Claim successful on node np0000000663
May 13 02:08:08.165856 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating resource usage from migration 73af0163-f292-42ae-9d00-439148932cad
May 13 02:08:08.410379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:08:08.410736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:08.410867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:08.411289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:08.411481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:08:08.430507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:08.431410 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:08.431790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:08.432012 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:08:08.432535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:08.434100 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:08:08.443222 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:08.455455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:08:08.455455 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:08.465492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:08:08.465492 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:08.479239 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23] added
May 13 02:08:08.479239 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:08:08.479239 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:08.479239 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:08.479239 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:08.479239 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:08.479239 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:08.479446 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:08:08.479729 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:08:08.479925 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:08:08.484755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23] added
May 13 02:08:08.484755 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:08:08.484755 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:08.484755 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:08.484755 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:08.484755 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:08.484755 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:08.484938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:08:08.485633 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0524(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:08:08.485633 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:08:08.847345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:08.847640 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:09.352363 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:09.480536 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:08:09.485883 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:09.498824 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:09.498824 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:09.510551 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:09.510551 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.520942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.529420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.542394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.542394 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.542394 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.542394 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.542394 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:09.542852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.542852 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.542852 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.542852 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.542852 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:09.554744 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.554744 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.554744 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.554744 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.554744 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:09.554974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.554974 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.554974 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.554974 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.554974 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:09.585431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.40.100,3260]
May 13 02:08:09.585431 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.40.100,3260] successful.
May 13 02:08:09.585431 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.595441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.50.100,3260]
May 13 02:08:09.595441 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.50.100,3260] successful.
May 13 02:08:09.595441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.601874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.612124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.621664 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.621910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:09.622182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:09.623302 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:09.625328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] HCTL ('9', '-', '-', 0) found on session 65 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:09.625328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:09.634777 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:09.635244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:09.635244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:09.635800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] HCTL ('10', '-', '-', 0) found on session 66 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:09.635919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:09.649399 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Searching for a device in session 65 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:09.649399 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:09.668395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Searching for a device in session 66 and hctl ['10', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:09.864689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.719s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:09.864846 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Migrating
May 13 02:08:09.865079 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:08:10.154614 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:08:10.387537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:10.388912 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:10.388912 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:10.431902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:10.663397 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Searching for a device in session 66 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:10.663655 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:10.803023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:10.890824 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:11.386113 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:11.457149 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Found WWN 3300000006835e97a for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:08:11.457757 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:11.458011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000006835e97a', 'path': '/dev/dm-1', 'multipath_id': '3300000006835e97a'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:11.458641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006835e97a', 'path': '/dev/dm-1', 'multipath_id': '3300000006835e97a'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:08:11.469461 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lazy-loading 'flavor' on Instance uuid c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:11.591839 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:11.795729 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:11.948855 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:11.948987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:11.975899 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Attempting to attach volume 4bf2cece-25a7-425e-a7fc-139194b34f23 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:08:11.977991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:   <alias name="ua-4bf2cece-25a7-425e-a7fc-139194b34f23"/>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:   <serial>4bf2cece-25a7-425e-a7fc-139194b34f23</serial>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]: </disk>
May 13 02:08:11.977991 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:08:12.094641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:12.270042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:12.450993 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:08:13.028119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:13.028572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:13.035676 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:13.035825 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Claim successful on node np0000000663
May 13 02:08:13.626160 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Starting migrate_disk_and_power_off {{(pid=98103) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 02:08:13.654382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:13.668224 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:13.668224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:13.668795 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:13.668980 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:13.669209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] No VIF found with MAC fa:16:3e:7e:fd:46, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:13.681228 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:13.835512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:13.843333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.009634 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance destroyed successfully.
May 13 02:08:14.010348 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999546807000115 future=<Future at 0x705c6c6430e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:14.011598 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:20Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:08:14.011898 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:14.012691 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:14.013035 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:08:14.014492 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.014777 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa71035b8-9f, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:14.016791 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.017514 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:14.017596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.018490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.018655 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=989d8e54-ca23-4114-90d5-1719151160f9) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:14.019680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.020240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:14.021246 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.024740 np0000000663 nova-compute[98103]: INFO os_vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f')
May 13 02:08:14.034899 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:14.035581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:14.035661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:14.035933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:14.036202 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:14.037627 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-313e7466-1cc9-4c14-bcee-a280b11f49cf req-8a19ca22-57f8-4672-9729-f1dbc91f5c2a service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received unexpected event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with vm_state active and task_state resize_migrating.
May 13 02:08:14.589582 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Detected multiple connections on this host for volume: c00e1f73-779a-4a20-a2b4-af0cf42f4547, skipping target disconnect.
May 13 02:08:14.600433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:14.622248 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:14.713510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:14.717138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:14.741932 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:14.742584 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:14.827760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:14.829625 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:08:14.829625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:14.945754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:14.947187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk.config /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:15.002375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk.config /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:15.002905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk.info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:15.064233 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_resize/disk.info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:15.250340 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:15.266678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8e36bc74-7104-4c8b-8010-8a0e9bd6ceed tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.857s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:15.434977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:15.764987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.737s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:15.770633 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:08:16.143387 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:16.144805 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:16.145166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:16.145611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:16.145898 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:16.146183 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8122bd29-cae5-4054-a38e-fc0aa5bfb7d4 req-088ac555-5074-4409-9b5c-d56f8fe67d01 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received unexpected event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with vm_state active and task_state resize_migrating.
May 13 02:08:16.233360 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:16.233662 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:16.274289 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event volume-extended-4bf2cece-25a7-425e-a7fc-139194b34f23 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:16.280789 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638081.2766657, ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:16.280789 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] VM Stopped (Lifecycle Event)
May 13 02:08:16.283168 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.006372936999923695 future=<Future at 0x705c6c665010 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:16.284494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:08:16.284692 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:08:16.285661 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:16.286896 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:16.287344 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=12.722422805000178 future=<Future at 0x705c6c6430e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:16.287654 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:16.293195 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=12.716902967000124 future=<Future at 0x705c6c6430e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:16.324598 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Port a71035b8-9f4c-437d-b410-614dc6551a90 binding to destination host np0000000663 is already ACTIVE {{(pid=98103) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 02:08:16.363478 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97a1ac6dead24ce08dfd2baf9d479723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb53ee1a74401a96398c636f94fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:08:16.689493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:16.778798 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Handling volume-extended event for volume 4bf2cece-25a7-425e-a7fc-139194b34f23 {{(pid=98103) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 13 02:08:16.781484 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:08:16.787230 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2924950e-9d18-47dc-abae-63b203c75915 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: ce8cd3d2-a0cf-47e7-b75a-e0b1a5f8dae5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:17.268924 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Successfully created port: a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:08:17.285497 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Cinder extended volume 4bf2cece-25a7-425e-a7fc-139194b34f23; extending it to detect new size
May 13 02:08:17.291994 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:08:17.337120 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:08:17.376398 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:17.378194 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:17.378568 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:17.880940 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] calling os-brick to extend iSCSI Volume {{(pid=98103) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 13 02:08:17.881283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}), 'kwargs': {}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:17.881443 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:17.881891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:17.882222 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}
May 13 02:08:17.882341 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Multipath discovery for iSCSI enabled
May 13 02:08:17.882545 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0']
May 13 02:08:17.882679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0'] {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 13 02:08:17.908592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0'] {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 13 02:08:17.908782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Running cmd (subprocess): lsscsi {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:17.966721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] CMD "lsscsi" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:17.967935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98103) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 13 02:08:17.968079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', 'host': '9', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 13 02:08:17.982039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Starting size: 1073741824 {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 13 02:08:18.017150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] volume size after scsi device rescan 2147483648 {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 13 02:08:18.017712 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Running cmd (subprocess): lsscsi {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.082892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] CMD "lsscsi" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.087734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98103) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 13 02:08:18.092277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 13 02:08:18.107501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Starting size: 1073741824 {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 13 02:08:18.137649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] volume size after scsi device rescan 2147483648 {{(pid=98103) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 13 02:08:18.151403 np0000000663 nova-compute[98103]: INFO os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Find Multipath device file for volume WWN 3300000006835e97a
May 13 02:08:18.151730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-3300000006835e97a exists yet. {{(pid=98103) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 13 02:08:18.151872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] /dev/disk/by-id/dm-uuid-mpath-3300000006835e97a has shown up. {{(pid=98103) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 13 02:08:18.180774 np0000000663 nova-compute[98103]: INFO os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000006835e97a) current size 1073741824
May 13 02:08:18.307065 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:08:18.308687 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:08:18.308979 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Creating image(s)
May 13 02:08:18.310379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:18.310379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:18.310379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:18.311035 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:18.315536 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:18.318138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.371891 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:18.432341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.440057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:18.440057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:18.440415 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:18.445035 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:18.445448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.572522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.573779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.604120 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Successfully updated port: a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:08:18.647594 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk 1073741824" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.648545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:18.649359 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.685682 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-changed-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:18.687276 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Refreshing instance network info cache due to event network-changed-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:18.688243 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] Acquiring lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:18.691498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] Acquired lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:18.691881 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Refreshing network info cache for port a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:18.738225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:18.738225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:18.738225 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:18.779788 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.131s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.780508 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:18.780749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:18.897891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:18.898602 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Cannot resize image /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:18.901515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:18.901515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Ensure instance console log exists: /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:18.901515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:18.901881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:18.901881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:19.020452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:19.112602 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:19.201833 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:19.230483 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:19.242014 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:19.285010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:19.451114 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:19.493915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:19.494114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:19.615869 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:19.812475 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:19.954325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1317cbac-57c7-41f2-ada5-d26d5901e31f req-f189ef11-90e8-4419-a66f-fdd6ca48db23 service nova] Releasing lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:19.954833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquired lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:19.955048 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:19.996278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:08:20.314928 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:20.374680 np0000000663 nova-compute[98103]: INFO os_brick.initiator.linuxscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-3300000006835e97a) new size 2147483648
May 13 02:08:20.379724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 2.493s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:20.379724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] <== extend_volume: return (2495ms) 2147483648 {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:20.379724 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Extend iSCSI Volume: new_size=2147483648 {{(pid=98103) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 13 02:08:20.389257 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [req-7f71d777-7bb2-455b-a25a-1ce55916befb req-43c3d0ea-89c8-48ff-8f08-34d3a5e380b8 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Resizing target device /dev/dm-1 to 2147483648 {{(pid=98103) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 13 02:08:20.439179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:20.603487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:20.604016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:20.609668 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:20.609668 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Claim successful on node np0000000663
May 13 02:08:20.623346 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:20.830126 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:20.846390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:08:20.883680 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:20.888085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:20.945802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:08:20.946270 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:08:20.963888 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:08:20.965549 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe7e:fd46', 'fe80::2c65:7aff:feb9:9a72', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fede:c209'] 
May 13 02:08:20.965719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:08:20.965857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:08:20.967670 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:21.179520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:21.181173 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:21.197562 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Updating instance_info_cache with network_info: [{"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:21.688122 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Detaching volume 4bf2cece-25a7-425e-a7fc-139194b34f23
May 13 02:08:21.703609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Releasing lock "refresh_cache-3234e5b7-40fb-4717-9c11-10e6a7739c6b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:21.703942 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance network_info: |[{"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:08:21.708042 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Start _get_guest_xml network_info=[{"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:21.716209 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:21.718317 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-788918988', uuid='3234e5b7-40fb-4717-9c11-10e6a7739c6b'), owner=OwnerMeta(userid='97a1ac6dead24ce08dfd2baf9d479723', username='tempest-VolumesActionsTest-1868975691-project-member', projectid='799fb53ee1a74401a96398c636f94fe2', projectname='tempest-VolumesActionsTest-1868975691'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638101.717886) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:21.724194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:21.724727 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:21.730130 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:21.730359 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:21.733379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:21.733748 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:21.733950 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:21.734081 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:21.734236 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:21.734315 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:21.734461 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:21.734689 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:21.736516 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:21.739549 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:21.739549 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:21.739549 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:21.756427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788918988',display_name='tempest-VolumesActionsTest-instance-788918988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-788918988',id=35,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-jgnxhm8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:17Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=3234e5b7-40fb-4717-9c11-10e6a7739c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:21.756427 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:21.757465 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:21.758278 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lazy-loading 'pci_devices' on Instance uuid 3234e5b7-40fb-4717-9c11-10e6a7739c6b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:21.760509 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Attempting to driver detach volume 4bf2cece-25a7-425e-a7fc-139194b34f23 from mountpoint /dev/vdb
May 13 02:08:21.775035 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Found disk vdb by alias ua-4bf2cece-25a7-425e-a7fc-139194b34f23 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:08:21.781783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Found disk vdb by alias ua-4bf2cece-25a7-425e-a7fc-139194b34f23 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:08:21.781783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Attempting to detach device vdb from instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:08:21.781783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <alias name="ua-4bf2cece-25a7-425e-a7fc-139194b34f23"/>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <serial>4bf2cece-25a7-425e-a7fc-139194b34f23</serial>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]: </disk>
May 13 02:08:21.781783 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:08:21.792229 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Successfully detached device vdb from instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa from the persistent domain config.
May 13 02:08:21.792395 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] (1/8): Attempting to detach device vdb with device alias ua-4bf2cece-25a7-425e-a7fc-139194b34f23 from instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:08:21.792706 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <alias name="ua-4bf2cece-25a7-425e-a7fc-139194b34f23"/>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <serial>4bf2cece-25a7-425e-a7fc-139194b34f23</serial>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]: </disk>
May 13 02:08:21.792706 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:08:21.866580 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:21.872322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:21.872322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:21.872322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:21.872322 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] No waiting events found dispatching network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:21.872322 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5e356fb1-13ef-44bf-9154-61baf80763e7 req-7506702c-c11d-40e2-b363-b4af4165ad25 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received unexpected event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b for instance with vm_state building and task_state spawning.
May 13 02:08:22.152339 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Starting finish_migration {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 02:08:22.153500 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:08:22.153625 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Creating image(s)
May 13 02:08:22.155511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:22.273130 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <uuid>3234e5b7-40fb-4717-9c11-10e6a7739c6b</uuid>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <name>instance-00000023</name>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesActionsTest-instance-788918988</nova:name>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:21</nova:creationTime>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:user uuid="97a1ac6dead24ce08dfd2baf9d479723">tempest-VolumesActionsTest-1868975691-project-member</nova:user>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:project uuid="799fb53ee1a74401a96398c636f94fe2">tempest-VolumesActionsTest-1868975691</nova:project>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         <nova:port uuid="a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="serial">3234e5b7-40fb-4717-9c11-10e6a7739c6b</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="uuid">3234e5b7-40fb-4717-9c11-10e6a7739c6b</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.config"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:53:5c:da"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <target dev="tapa88ccdb4-09"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/console.log" append="off"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:22.273130 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Preparing to wait for external event network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788918988',display_name='tempest-VolumesActionsTest-instance-788918988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-788918988',id=35,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-jgnxhm8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:17Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=3234e5b7-40fb-4717-9c11-10e6a7739c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.123s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:22.279158 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:22.283118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:22.287948 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:22.288350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baf352c8-06e6-593b-b56a-e78581e5a2a8', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:22.304138 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:22.311431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:22.311944 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88ccdb4-09, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:22.313751 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa88ccdb4-09, col_values=(('qos', UUID('3135871f-70e0-4930-b3a3-098962573636')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:22.314132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa88ccdb4-09, col_values=(('external_ids', {'iface-id': 'a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:5c:da', 'vm-uuid': '3234e5b7-40fb-4717-9c11-10e6a7739c6b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:22.320601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:22.325309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:22.327062 np0000000663 nova-compute[98103]: INFO os_vif [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09')
May 13 02:08:22.403672 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638102.403201, c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa => ua-4bf2cece-25a7-425e-a7fc-139194b34f23> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:08:22.404431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:22.405871 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4bf2cece-25a7-425e-a7fc-139194b34f23 for instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:08:22.407317 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:22.411309 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Successfully detached device vdb from instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa from the live domain config.
May 13 02:08:22.413826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:08:22.413826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:22.413826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:22.414158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:22.415164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4bf2cece-25a7-425e-a7fc-139194b34f23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:08:22.415621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:22.445170 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [66] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:22.445500 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:22.445500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', '65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6', '67')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:08:22.445869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', '65')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:08:22.446523 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23', '66')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:08:22.447289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c69b7e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:08:22.447543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:08:22.447763 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Flush multipath device 3300000006835e97a {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:08:22.458582 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:22.458889 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:22.486719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:08:22.533348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:08:22.582296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:08:22.582651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:08:22.584260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:08:22.602716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:08:22.602716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:08:22.617821 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.671692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.40.100,3260]
May 13 02:08:22.671692 np0000000663 nova-compute[98103]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.40.100,3260] successful.
May 13 02:08:22.671692 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.695238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.710452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.759550 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.50.100,3260]
May 13 02:08:22.759550 np0000000663 nova-compute[98103]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-4bf2cece-25a7-425e-a7fc-139194b34f23, portal: 192.168.50.100,3260] successful.
May 13 02:08:22.759550 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.781977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:22.782312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:22.782492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] <== disconnect_volume: return (368ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:22.782658 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:08:22.911122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:08:22.911360 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Ensure instance console log exists: /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:22.911737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:22.911966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:22.912189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:22.916277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start _get_guest_xml network_info=[{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '035777fc-feb7-4c85-97f5-322ea3fb60a7', 'attached_at': '2026-05-13T02:08:21.000000', 'detached_at': '', 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'multiattach': True, 'serial': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547'}, 'attachment_id': '88a53d1b-4689-4c11-862e-588a1fe48e5e', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:22.918691 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:22.920154 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='035777fc-feb7-4c85-97f5-322ea3fb60a7'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638102.9195602) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:22.920795 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:22.921110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:22.921786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:22.921954 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:22.922767 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:22.923056 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:22.923209 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:22.923294 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:22.923403 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:22.923481 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:22.923563 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:22.923688 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:22.923779 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:22.923877 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:22.923973 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:22.924103 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:22.937171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:22.965578 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:23.029754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:23.030394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:23.030783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:23.031417 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:23.031780 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:08:23.032218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:23.032388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:23.122923 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:23.123497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:23.384519 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lazy-loading 'flavor' on Instance uuid c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:23.477481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.874s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:23.477889 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:08:23.625630 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:08:23.864710 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:23.865049 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:23.865049 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No VIF found with MAC fa:16:3e:53:5c:da, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:23.865464 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Using config drive
May 13 02:08:23.983529 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:08:23.984129 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:08:23.984442 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:23.984778 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:24.083603 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3389815009742f7b71399449ef041ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cd0ac04b144296b82948ab2abe19a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:08:24.193951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:24.193951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:24.197461 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:24.197664 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Claim successful on node np0000000663
May 13 02:08:24.373497 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:24.393378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1f8d293a-d1c8-46f7-9fc5-94991d59157c tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.213s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:24.470755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:24.470933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:24.471158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:24.471385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:24.471584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:24.474847 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Terminating instance
May 13 02:08:24.488934 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:08:24.535467 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Creating config drive at /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.config
May 13 02:08:24.539763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzi5aw46t {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:24.594746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzi5aw46t" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:24.601954 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Successfully created port: 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:08:24.988424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:08:24.998570 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:08:25.022119 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.026668 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.045746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.055457 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.074593 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.098277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.135296 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.144029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.213041 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Successfully updated port: 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:08:25.235769 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.270533 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:25.270713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:25.273856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:25.274133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:25.274287 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] No waiting events found dispatching network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:25.274441 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cf5e69e1-873b-467b-bbf3-f2987d316f35 req-98f68db8-bcc1-4c4f-9ab1-46320359d22f service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:25.285133 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:25.287658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing instance network info cache due to event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:25.287658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:25.287658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:25.287658 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:25.378807 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998644910999928 future=<Future at 0x705c4870f1a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:25.385826 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Instance destroyed successfully.
May 13 02:08:25.385826 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lazy-loading 'resources' on Instance uuid c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:25.442363 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.529782 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.536602 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.540110 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.571142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.576516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.715747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:25.797115 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:25.864216 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:25.889175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-930831195',display_name='tempest-VolumesExtendAttachedTest-instance-930831195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesextendattachedtest-instance-930831195',id=31,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYAOknbOrFnvQscAGrKlSzg+VefUlSG08ho6pgvuVwiXVI0FcNaX0gdyOb2U/ieWcojbUvDaOLL0H8M9t4XI9m2xSw4NLtFEURdupDDqVplwXQiaiHtBFxzztEKIxRsMQ==',key_name='tempest-keypair-452794165',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:24Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec9eeb94f4b745e38a31c2a39079ce9c',ramdisk_id='',reservation_id='r-x9d79cg3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1785069232',owner_user_name='tempest-VolumesExtendAttachedTest-1785069232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:07:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c48805ea23124cb188bc686600c2f9f8',uuid=c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:08:25.889175 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converting VIF {"id": "55004634-53db-4c39-a811-a8b1a6a35417", "address": "fa:16:3e:7e:fd:46", "network": {"id": "616a8f8f-b739-4a16-a791-64699c04ae22", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1724127920-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ec9eeb94f4b745e38a31c2a39079ce9c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap55004634-53", "ovs_interfaceid": "55004634-53db-4c39-a811-a8b1a6a35417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:25.889765 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:25.889990 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:08:25.892886 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.893160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55004634-53, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:25.895598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.897331 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:25.898117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.898307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58561380-958e-4f8a-ac0a-8158b79fc546) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:25.899436 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.899568 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:25.903172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:25.904079 np0000000663 nova-compute[98103]: INFO os_vif [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fd:46,bridge_name='br-int',has_traffic_filtering=True,id=55004634-53db-4c39-a811-a8b1a6a35417,network=Network(616a8f8f-b739-4a16-a791-64699c04ae22),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55004634-53')
May 13 02:08:25.904447 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Deleting instance files /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa_del
May 13 02:08:25.905368 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Deletion of /opt/stack/data/nova/instances/c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa_del complete
May 13 02:08:26.001652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:26.002163 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:26.012214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.980s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:26.012511 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:08:26.015033 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:08:26.016183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:08:26.016474 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Creating image(s)
May 13 02:08:26.017008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:26.017170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:26.017644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:26.018186 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:26.021274 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:26.024227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:26.025042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:26.025584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:26.026221 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:26.026221 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:08:26.026688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:26.027201 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:26.047008 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:26.047008 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:26.054593 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:26.060068 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:26.060068 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:26.067679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:26.075487 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.085158 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.085454 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:26.085690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.060s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:26.085833 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:26.086830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('8', '0', '0', 0) found on session 64 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:26.086959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ed550816-015f-4607-afab-b948a7c907a6 (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]: tcp: [69] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0e95988b-c3c7-4b73-935c-5b819a9d803a (non-flash)
May 13 02:08:26.099910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:26.100745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 64 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:26.100885 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:26.103449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:26.103449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:26.103449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('7', '0', '0', 0) found on session 63 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:26.103449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:26.112080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 63 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:26.112080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:26.121344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:26.121738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:26.122125 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:26.124023 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:26.129806 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:26.130542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:26.202503 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638106.2018917, 3234e5b7-40fb-4717-9c11-10e6a7739c6b => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:26.202669 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] VM Started (Lifecycle Event)
May 13 02:08:26.212820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.082s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:26.213134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:26.276120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk 1073741824" returned: 0 in 0.063s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:26.276606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:26.277053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:26.377063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:26.378176 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:26.378374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:26.418416 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Took 1.43 seconds to destroy the instance on the hypervisor.
May 13 02:08:26.419579 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:08:26.419997 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:08:26.420189 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:08:26.420869 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:26.490244 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:26.492313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:26.492688 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Cannot resize image /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:26.493068 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:26.493291 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Ensure instance console log exists: /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:26.493631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:26.493845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:26.493994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:26.505508 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:26.561037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-56031c5c-6de4-4c29-9534-87db840adf24 req-acc3747b-f867-4fd3-8828-bc8e3ab7039a service nova] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:26.561999 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:26.562336 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:26.709064 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:26.712632 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638106.712272, 3234e5b7-40fb-4717-9c11-10e6a7739c6b => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:26.712954 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] VM Paused (Lifecycle Event)
May 13 02:08:27.016159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.822s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:27.016645 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:08:27.028376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:08:27.153415 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:27.218260 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:27.220345 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:27.322598 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:27.335275 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:27.335495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Acquiring lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:27.335779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:27.335994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:27.336518 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] No waiting events found dispatching network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:27.336677 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-unplugged-55004634-53db-4c39-a811-a8b1a6a35417 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:27.336833 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:27.337037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:27.337225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:27.337389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:27.337575 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Processing event network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:27.337858 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:27.338182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:27.338683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:27.338970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:27.339041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:27.339194 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] No waiting events found dispatching network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:27.339332 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received unexpected event network-vif-plugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b for instance with vm_state building and task_state spawning.
May 13 02:08:27.339420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Received event network-vif-deleted-55004634-53db-4c39-a811-a8b1a6a35417 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:27.339535 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Neutron deleted interface 55004634-53db-4c39-a811-a8b1a6a35417; detaching it from the instance and deleting it from the info cache
May 13 02:08:27.339652 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:27.341413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:27.343616 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance spawned successfully.
May 13 02:08:27.344601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:27.446103 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:27.524709 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:08:27.524829 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:08:27.525197 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:27.525834 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:27.530571 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:27.612966 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2554c8defe944528a06bbfd6f360dcd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635951473383437bbabc3b1bb776416a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:08:27.723007 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:27.723442 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638107.7231908, 3234e5b7-40fb-4717-9c11-10e6a7739c6b => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:27.723619 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] VM Resumed (Lifecycle Event)
May 13 02:08:27.847489 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9c3d743e-dfac-4b73-84f3-df0995cc1a91 req-7dc8c3d9-ee82-4eff-b4c3-86f56ad78632 service nova] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Detach interface failed, port_id=55004634-53db-4c39-a811-a8b1a6a35417, reason: Instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:08:27.855514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.855514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.855820 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.858585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.858585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.858585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:27.949711 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Took 1.53 seconds to deallocate network for instance.
May 13 02:08:28.032336 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:08:28.034869 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:28.035916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance network_info: |[{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:08:28.038693 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start _get_guest_xml network_info=[{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:28.043020 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:28.044796 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-592188464', uuid='b30e4097-0d76-4cae-a3d4-175cd5c6c5a9'), owner=OwnerMeta(userid='b3389815009742f7b71399449ef041ce', username='tempest-ServerStableDeviceRescueTest-1052023346-project-member', projectid='89cd0ac04b144296b82948ab2abe19a8', projectname='tempest-ServerStableDeviceRescueTest-1052023346'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638108.0442948) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:28.047753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:28.048318 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:28.048836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 330000000f04cf47c for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:08:28.049396 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:28.049734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (5016ms) {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:28.050707 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:08:28.054457 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:28.054828 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:28.055802 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:28.056063 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:28.056235 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:28.057868 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:28.058040 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:28.058177 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:28.058284 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:28.058457 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:28.058590 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:28.058700 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:28.059060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:28.059060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:28.082886 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-592188464',display_name='tempest-ServerStableDeviceRescueTest-server-592188464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverstabledevicerescuetest-server-592188464',id=36,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzDp/iyzFWE16MhS1cHYitjK+qGSRXAJhbgNOwBMlaTtO0N/gf+8RLfV6FWr9beX98956BGPdKq/GVVrrOgxASAg4p1dYvuTVnd3mwysylQdtQ8ikEZPxdZcxL5A4yvfA==',key_name='tempest-keypair-1887025731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89cd0ac04b144296b82948ab2abe19a8',ramdisk_id='',reservation_id='r-fsvbfaex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1052023346',owner_user_name='tempest-ServerStableDeviceRescueTest-1052023346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3389815009742f7b71399449ef041ce',uuid=b30e4097-0d76-4cae-a3d4-175cd5c6c5a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:28.083180 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converting VIF {"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:28.083709 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:28.084308 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'pci_devices' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:28.223797 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Successfully created port: 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:08:28.230472 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:28.237114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:28.363296 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Took 10.06 seconds to spawn the instance on the hypervisor.
May 13 02:08:28.363686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:28.466610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:28.466761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:28.538132 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:08:28.601222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:20Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:28.601547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <uuid>b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</uuid>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <name>instance-00000024</name>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-592188464</nova:name>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:28</nova:creationTime>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:user uuid="b3389815009742f7b71399449ef041ce">tempest-ServerStableDeviceRescueTest-1052023346-project-member</nova:user>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:project uuid="89cd0ac04b144296b82948ab2abe19a8">tempest-ServerStableDeviceRescueTest-1052023346</nova:project>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         <nova:port uuid="2a80ff1d-8a2e-411d-8a2d-ea257e40f944">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="serial">b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="uuid">b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7d:2e:e1"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <target dev="tap2a80ff1d-8a"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/console.log" append="off"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:28.601547 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Preparing to wait for external event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-592188464',display_name='tempest-ServerStableDeviceRescueTest-server-592188464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverstabledevicerescuetest-server-592188464',id=36,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzDp/iyzFWE16MhS1cHYitjK+qGSRXAJhbgNOwBMlaTtO0N/gf+8RLfV6FWr9beX98956BGPdKq/GVVrrOgxASAg4p1dYvuTVnd3mwysylQdtQ8ikEZPxdZcxL5A4yvfA==',key_name='tempest-keypair-1887025731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89cd0ac04b144296b82948ab2abe19a8',ramdisk_id='',reservation_id='r-fsvbfaex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1052023346',owner_user_name='tempest-ServerStableDeviceRescueTest-1052023346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3389815009742f7b71399449ef041ce',uuid=b30e4097-0d76-4cae-a3d4-175cd5c6c5a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:28.604031 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converting VIF {"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:28.604801 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:28.604801 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <uuid>035777fc-feb7-4c85-97f5-322ea3fb60a7</uuid>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <name>instance-0000001e</name>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <memory>262144</memory>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-0</nova:name>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:22</nova:creationTime>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.micro" id="84">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:memory>256</nova:memory>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         <nova:port uuid="a71035b8-9f4c-437d-b410-614dc6551a90">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="serial">035777fc-feb7-4c85-97f5-322ea3fb60a7</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="uuid">035777fc-feb7-4c85-97f5-322ea3fb60a7</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk.config"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <shareable/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:53:33:ed"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <target dev="tapa71035b8-9f"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/console.log" append="off"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:28.610984 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:20Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:53:33:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.610984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:28.614763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.614763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73d77913-137d-50db-bab5-2cb9a7ce0fcc', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.616268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.616407 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:28.616877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.617012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f5f59973-ba59-554c-a730-07fd464856c2', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.617563 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.618166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:28.620850 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.621026 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa71035b8-9f, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.621652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa71035b8-9f, col_values=(('qos', UUID('b1c46a75-702d-4124-95a7-d3026d5e9d59')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.621815 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa71035b8-9f, col_values=(('external_ids', {'iface-id': 'a71035b8-9f4c-437d-b410-614dc6551a90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:33:ed', 'vm-uuid': '035777fc-feb7-4c85-97f5-322ea3fb60a7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.622576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.623714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:28.629040 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.629436 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.629569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a80ff1d-8a, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.629817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a80ff1d-8a, col_values=(('qos', UUID('eeca926f-a4aa-4c41-88fc-c116ec3a466a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.629939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a80ff1d-8a, col_values=(('external_ids', {'iface-id': '2a80ff1d-8a2e-411d-8a2d-ea257e40f944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:2e:e1', 'vm-uuid': 'b30e4097-0d76-4cae-a3d4-175cd5c6c5a9'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:28.630836 np0000000663 nova-compute[98103]: INFO os_vif [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f')
May 13 02:08:28.636437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:28.645795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:28.649418 np0000000663 nova-compute[98103]: INFO os_vif [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a')
May 13 02:08:28.740433 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:28.875567 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Took 15.92 seconds to build instance.
May 13 02:08:28.947053 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Successfully updated port: 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:08:29.010251 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00041289699993285467 future=<Future at 0x705c6c6430e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:29.010663 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Emitting event <LifecycleEvent: 1778638094.0096824, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:29.010820 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:29.011288 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Stopped (Lifecycle Event)
May 13 02:08:29.011989 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.365472114000113 future=<Future at 0x705c4870f1a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:29.012064 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.365344647000029 future=<Future at 0x705c4870f1a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:29.278924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:29.279414 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:29.377738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a999f507-200b-47b1-916d-586f2bc66b49 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.429s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:29.426129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:29.426422 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing instance network info cache due to event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:29.426617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:29.426747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:29.426809 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:29.451861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:29.513768 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:29.516487 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:29.559486 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:08:29.560266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:08:29.560498 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating image(s)
May 13 02:08:29.560957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:29.561154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:29.561608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:29.566253 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:29.570397 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:29.571789 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:29.666930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:29.667445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:29.668050 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:29.670962 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:29.675850 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:29.676620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:29.770857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:29.772182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:29.789991 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:29.836241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk 1073741824" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:29.836485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:29.836728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:29.930504 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:29.934523 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:29.935157 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:29.935400 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:30.021422 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 02:08:30.024517 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:30.030490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:30.032069 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Cannot resize image /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:30.032515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:30.032730 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Ensure instance console log exists: /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:30.033057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:30.033277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:30.033407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:30.164067 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:30.176693 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:30.176809 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:30.176935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:30.176998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:53:33:ed, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:30.177578 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Using config drive
May 13 02:08:30.179795 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:30.179879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:30.180037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No VIF found with MAC fa:16:3e:7d:2e:e1, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:30.180443 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Using config drive
May 13 02:08:30.299888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.833s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:30.346721 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Deleted allocations for instance c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa
May 13 02:08:30.452212 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.624194 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.670360 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c6b053b5-4c02-44cb-aff0-28d45abe469c req-f60f4f82-f255-404d-8786-c32ea9496eff service nova] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:30.670360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.670360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.670360 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:30.670677 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:30.692627 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:30.797573 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.812879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.824829 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:30.921193 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Creating config drive at /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config
May 13 02:08:30.929181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt0c6pzin {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:30.940801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:30.941964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:30.961431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:30.971004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:30.971311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.009s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:30.975893 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:30.975893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:30.976121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:30.976833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:30.977432 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:30.977432 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b7838b60-8f76-4208-aa15-85393b0daad8 req-c1b02c3e-a798-4f52-9e9f-e792ab0bb782 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received unexpected event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with vm_state active and task_state resize_finish.
May 13 02:08:30.982661 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Terminating instance
May 13 02:08:31.036631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt0c6pzin" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:31.260444 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:31.362275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e61f9120-8b3d-4ba9-8a96-cb2eb57c9fdc tempest-VolumesExtendAttachedTest-1785069232 tempest-VolumesExtendAttachedTest-1785069232-project-member] Lock "c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.891s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:31.490163 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:08:31.506056 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:31.540288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.563229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.598817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.624124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.662273 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.742054 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:31.768832 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:31.886013 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:31.886358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:31.886552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:31.886686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:31.886877 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] No waiting events found dispatching network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:31.887135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e032061d-3346-4cca-a9a8-284beda4c9ff req-ee4beb51-eaec-45ec-a0aa-f722d0806237 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:31.930964 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999662331000081 future=<Future at 0x705c6c12d700 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:31.938517 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Instance destroyed successfully.
May 13 02:08:31.939044 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lazy-loading 'resources' on Instance uuid 3234e5b7-40fb-4717-9c11-10e6a7739c6b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:31.971468 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9a4e0ea7-ae21-497b-9073-30ef375642e4 req-418788a4-22e5-414c-b6cf-eb289ca880e4 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:31.973347 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a4e0ea7-ae21-497b-9073-30ef375642e4 req-418788a4-22e5-414c-b6cf-eb289ca880e4 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:31.973575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a4e0ea7-ae21-497b-9073-30ef375642e4 req-418788a4-22e5-414c-b6cf-eb289ca880e4 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:31.973767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9a4e0ea7-ae21-497b-9073-30ef375642e4 req-418788a4-22e5-414c-b6cf-eb289ca880e4 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:31.974911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9a4e0ea7-ae21-497b-9073-30ef375642e4 req-418788a4-22e5-414c-b6cf-eb289ca880e4 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Processing event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:31.982813 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638111.9824471, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:31.983622 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:31.984280 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Resumed (Lifecycle Event)
May 13 02:08:31.995945 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance running successfully.
May 13 02:08:31.999641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Failed to set time: agent not configured {{(pid=98103) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 02:08:31.999641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-afc57257-2f6a-4fab-9f82-74cdef1f19c2 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] finish_migration finished successfully. {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 02:08:32.091205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.098799 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.132960 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.244772 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:32.244895 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance network_info: |[{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:08:32.250519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start _get_guest_xml network_info=[{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:32.261399 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:32.261399 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-677316047', uuid='0eb5ec8d-4f76-4777-9adc-36852d35ebbc'), owner=OwnerMeta(userid='2554c8defe944528a06bbfd6f360dcd4', username='tempest-AttachVolumeShelveTestJSON-970754436-project-member', projectid='635951473383437bbabc3b1bb776416a', projectname='tempest-AttachVolumeShelveTestJSON-970754436'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638112.260596) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:32.267208 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:32.267649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:32.273184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:32.273413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:32.274941 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:32.278170 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:32.278170 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:32.278523 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:32.278859 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:32.279110 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:32.279427 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:32.279609 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:32.279799 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:32.282068 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:32.282068 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:32.282068 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:32.302743 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPee8wUzwjPQReGLhZtrxeUFa0M4Zb++1dNjlQM/Z/y4Coy97qBkjjl0WUIgmQCOofI7a2FVZnr9Ovg/mMy5at1FCudLBbMc1J5eRRYTK+HwpyfZT7s0YFq7zNWFRDFacQ==',key_name='tempest-keypair-1729290138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:32.302743 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:32.303564 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:32.304440 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_devices' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:32.441567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-788918988',display_name='tempest-VolumesActionsTest-instance-788918988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-788918988',id=35,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:28Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-jgnxhm8s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:08:28Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=3234e5b7-40fb-4717-9c11-10e6a7739c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:08:32.442208 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "address": "fa:16:3e:53:5c:da", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88ccdb4-09", "ovs_interfaceid": "a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:32.442512 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:32.442777 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:08:32.446819 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.447261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88ccdb4-09, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.448749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.449982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:32.450916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.452067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.452298 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3135871f-70e0-4930-b3a3-098962573636) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.452900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.453704 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:32.454368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.459607 np0000000663 nova-compute[98103]: INFO os_vif [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:5c:da,bridge_name='br-int',has_traffic_filtering=True,id=a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88ccdb4-09')
May 13 02:08:32.460025 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Deleting instance files /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b_del
May 13 02:08:32.463361 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Deletion of /opt/stack/data/nova/instances/3234e5b7-40fb-4717-9c11-10e6a7739c6b_del complete
May 13 02:08:32.490008 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:32.498068 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:32.807482 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <uuid>0eb5ec8d-4f76-4777-9adc-36852d35ebbc</uuid>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <name>instance-00000025</name>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-677316047</nova:name>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:32</nova:creationTime>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:user uuid="2554c8defe944528a06bbfd6f360dcd4">tempest-AttachVolumeShelveTestJSON-970754436-project-member</nova:user>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:project uuid="635951473383437bbabc3b1bb776416a">tempest-AttachVolumeShelveTestJSON-970754436</nova:project>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         <nova:port uuid="80ad54cb-0c0b-4504-ae94-326b9005d7b7">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="serial">0eb5ec8d-4f76-4777-9adc-36852d35ebbc</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="uuid">0eb5ec8d-4f76-4777-9adc-36852d35ebbc</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:50:17:9d"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <target dev="tap80ad54cb-0c"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/console.log" append="off"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:32.807482 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Preparing to wait for external event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPee8wUzwjPQReGLhZtrxeUFa0M4Zb++1dNjlQM/Z/y4Coy97qBkjjl0WUIgmQCOofI7a2FVZnr9Ovg/mMy5at1FCudLBbMc1J5eRRYTK+HwpyfZT7s0YFq7zNWFRDFacQ==',key_name='tempest-keypair-1729290138',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.810410 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.811112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:32.811469 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.811658 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83bc442c-a978-56f5-9e31-a20db46fe495', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.812574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.813427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:32.815458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.817302 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.817479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80ad54cb-0c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.817848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80ad54cb-0c, col_values=(('qos', UUID('dae1eea7-23ac-4d5e-ac15-376e02f75842')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.818609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80ad54cb-0c, col_values=(('external_ids', {'iface-id': '80ad54cb-0c0b-4504-ae94-326b9005d7b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:17:9d', 'vm-uuid': '0eb5ec8d-4f76-4777-9adc-36852d35ebbc'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:32.819072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.820159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:32.829104 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:32.830209 np0000000663 nova-compute[98103]: INFO os_vif [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c')
May 13 02:08:32.897165 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:32.904745 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:32.906855 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance spawned successfully.
May 13 02:08:32.907269 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:32.975066 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Took 1.48 seconds to destroy the instance on the hypervisor.
May 13 02:08:32.975814 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:08:32.978324 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:08:32.978324 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:08:32.978324 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:33.002247 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 02:08:33.005205 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638113.004836, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:33.006193 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Started (Lifecycle Event)
May 13 02:08:33.043135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:33.046239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:33.046239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:33.046239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:33.046239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:33.046239 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7273784d-c2a8-400c-a97a-50396a6698d5 req-51da31ce-ef75-470f-9cfd-4c8605cab9a5 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received unexpected event network-vif-plugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with vm_state resized and task_state None.
May 13 02:08:33.083697 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:33.419043 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.419509 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.419924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.420331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.420856 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.421172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:33.512510 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:33.516591 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:33.806953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:33.807256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:33.807469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Going to confirm migration 3 {{(pid=98103) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 02:08:33.882115 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:33.929854 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Took 7.91 seconds to spawn the instance on the hypervisor.
May 13 02:08:33.929854 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:33.976052 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:33.976233 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] Acquiring lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:33.976409 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:33.976554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:33.976690 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] No waiting events found dispatching network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:33.976816 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2320a14-ce9b-44d7-87bf-c4b9248b72b2 req-b6cfb19a-83c0-4af9-859e-028c9e75af48 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-unplugged-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:34.019060 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638114.0187008, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:34.023589 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Started (Lifecycle Event)
May 13 02:08:34.056948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:34.057168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:34.057354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:34.057576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:34.057674 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:34.057819 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-1fd6ce6d-b1c1-4aed-afc4-eb9f09882a68 req-5accb49b-ac06-43df-aac8-af9ed8f903e0 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state active and task_state None.
May 13 02:08:34.314597 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:34.367226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:34.367420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:34.367589 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No VIF found with MAC fa:16:3e:50:17:9d, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:34.368162 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Using config drive
May 13 02:08:34.384118 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Took 1.41 seconds to deallocate network for instance.
May 13 02:08:34.437941 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Took 13.94 seconds to build instance.
May 13 02:08:34.485809 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:34.486138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:34.486286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:34.486442 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:34.486615 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'info_cache' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:34.525738 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:34.530268 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:34.880244 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:34.890895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:34.891161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:34.939349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.445s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:35.034367 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638115.0324962, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:35.034367 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Paused (Lifecycle Event)
May 13 02:08:35.093619 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating config drive at /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config
May 13 02:08:35.106153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp35tibltx {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:35.130699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:35.143608 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dfa33eff-f8c4-4081-bea5-da570d594fc8 req-c00cc9cb-ffd8-4cd9-a0a1-021105598b80 service nova] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Received event network-vif-deleted-a88ccdb4-09ee-4e5f-8fef-052d39ce3d3b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:35.182542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp35tibltx" returned: 0 in 0.077s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:35.456870 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:35.497293 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:35.546240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:35.549661 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638115.5493798, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:35.550508 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Resumed (Lifecycle Event)
May 13 02:08:35.750437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:35.786343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:35.832695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:35.832695 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:35.935431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:36.053983 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:36.061905 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:36.090357 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:36.160625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:36.160808 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing instance network info cache due to event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:36.162537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:36.162537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:36.162537 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:36.188831 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:36.192822 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:36.225012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:36.306558 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:36.336361 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:36.667047 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:36.811588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:36.811781 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'migration_context' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:36.841403 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638116.840669, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:36.841403 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Started (Lifecycle Event)
May 13 02:08:36.845198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.954s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:36.929648 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Deleted allocations for instance 3234e5b7-40fb-4717-9c11-10e6a7739c6b
May 13 02:08:37.098006 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:37.244887 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:37.245474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:37.245651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:37.245838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:37.245992 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Processing event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:37.247664 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:37.249376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:37.249562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:37.249756 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:37.249895 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:37.250101 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-bc1d797f-2f28-40ff-9b9b-8d515240720b req-801f5da8-c0a1-42ac-b436-01e5bf3e15b7 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received unexpected event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with vm_state building and task_state spawning.
May 13 02:08:37.252336 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:37.255274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:37.260464 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance spawned successfully.
May 13 02:08:37.260464 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:37.304374 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updated VIF entry in instance network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:08:37.304684 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:37.314869 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Object Instance<035777fc-feb7-4c85-97f5-322ea3fb60a7> lazy-loaded attributes: info_cache,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:37.320873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:37.321067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:37.345698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:37.352300 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:37.772205 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.772693 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.773603 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.773993 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.774367 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.774950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:37.802393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:37.807241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1a4b27a8-88d1-4db8-ab37-a37a5474ba24 req-132ae1c8-e2bc-45b9-aab5-68fa68e5dd6c service nova] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:37.820724 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:37.855275 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:37.855426 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638117.855234, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:37.855575 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Paused (Lifecycle Event)
May 13 02:08:37.939757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e93ce476-33d9-48f1-a55b-c7f2b2cebc7e tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "3234e5b7-40fb-4717-9c11-10e6a7739c6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.999s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:38.283774 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Took 8.72 seconds to spawn the instance on the hypervisor.
May 13 02:08:38.284055 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:38.362991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:38.367554 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638118.367138, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:38.367791 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Resumed (Lifecycle Event)
May 13 02:08:38.496906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:38.497430 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:38.804411 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Took 14.67 seconds to build instance.
May 13 02:08:38.875697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:38.882136 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:39.001454 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:39.306776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6fd70c7-4549-4125-9459-abb29c009014 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:39.781548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:39.781548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:39.973775 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:39.974271 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing instance network info cache due to event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:39.974271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:39.974436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:39.974484 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:40.021168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.700s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:40.283939 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:08:40.377990 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00046181600009731483 future=<Future at 0x705c4870f1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:40.378796 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:40.379274 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] Emitting event <LifecycleEvent: 1778638105.377349, c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:40.379514 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.551078178999887 future=<Future at 0x705c6c12d700 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:40.379657 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.550921888999937 future=<Future at 0x705c6c12d700 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:40.379797 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] VM Stopped (Lifecycle Event)
May 13 02:08:40.457679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:40.480997 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:40.682926 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocation for migration 73af0163-f292-42ae-9d00-439148932cad
May 13 02:08:40.853806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:40.853982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:40.859185 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:40.859374 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Claim successful on node np0000000663
May 13 02:08:40.863322 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:40.883196 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d85679f-1857-4445-8f5a-7fa5023889b0 tempest-ServerActionsTestOtherA-1936571963 tempest-ServerActionsTestOtherA-1936571963-project-member] [instance: c8c6a984-a9e0-4404-8ab6-ec3d82a8c9fa] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:41.010564 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updated VIF entry in instance network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:08:41.011063 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:41.137066 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:41.137240 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:41.187418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1b66b7e0-3119-426a-a2f5-b77593ac26cf tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.380s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:41.513220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee33ea07-c1de-40a9-90af-ca3accf90b55 req-0fe60dc3-76ae-4b0d-921a-ae392307d0ca service nova] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:41.641413 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'flavor' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:42.417433 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:42.417969 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing instance network info cache due to event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:42.417969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:42.417969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:42.417969 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:42.532319 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:42.532555 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:42.652892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:42.704540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:42.704728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:42.827601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:42.919979 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:43.036459 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:43.211497 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:08:43.320348 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:43.491378 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updated VIF entry in instance network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:08:43.492205 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:43.542603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.688s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:43.542974 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:08:43.755821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:43.756859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:43.759897 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attaching volume 75230db6-8513-4f57-aa91-7bdff1fcb9a5 to /dev/vdb
May 13 02:08:43.769366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:43.769537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:43.774631 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:08:43.775070 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Claim successful on node np0000000663
May 13 02:08:43.823211 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:43.837427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:08:43.860114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:43.906184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:08:43.909547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:08:43.920131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:08:43.921141 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fede:c209', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71', 'fe80::fc16:3eff:fe50:179d', 'fe80::34d7:b7ff:fe3c:7526'] 
May 13 02:08:43.921372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:08:43.921424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:08:43.921717 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:43.923808 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating existing volume attachment record: 1942ba06-a023-4398-bf3e-e675aaea48a2 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:08:43.995049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d105691c-3577-4d9d-bcc9-f280d6d5e67b req-d5ab249c-72b3-4079-b035-f87560c93ad0 service nova] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:44.052719 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:08:44.052974 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:08:44.053427 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:44.054616 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:44.178809 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97a1ac6dead24ce08dfd2baf9d479723', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799fb53ee1a74401a96398c636f94fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:08:44.480846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:08:44.481635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:08:44.481769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:44.482129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:44.482386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:08:44.499409 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:44.499409 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing instance network info cache due to event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:44.499409 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:44.499409 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:44.499409 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:44.500867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:44.501643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:08:44.502730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:44.502915 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:08:44.503480 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:08:44.503782 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:08:44.525413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:08:44.525413 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:44.526361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:08:44.526361 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:44.552048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5] added
May 13 02:08:44.552048 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:08:44.552048 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:44.552048 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:44.552048 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:44.552048 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:44.552048 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:44.552365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:08:44.552586 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0488(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:08:44.552779 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:08:44.553492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5] added
May 13 02:08:44.553492 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:08:44.553492 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:44.553492 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:44.553492 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:08:44.553492 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:08:44.553492 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:44.553708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:08:44.554002 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.051(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:08:44.556443 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:08:44.556633 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:08:44.711800 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Successfully created port: be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:08:45.004647 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:45.064045 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:08:45.317504 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Successfully updated port: be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:08:45.370635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-changed-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:45.370789 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Refreshing instance network info cache due to event network-changed-be505a25-4148-4a9b-89c3-b931bcd316a0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:45.370936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] Acquiring lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:45.371398 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] Acquired lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:45.371398 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Refreshing network info cache for port be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:45.460591 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:45.473476 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:45.554814 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:08:45.556886 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:45.575546 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:45.575546 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:08:45.578675 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:08:45.578675 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.592447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.598433 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.613123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.613123 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.613123 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.613123 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.613123 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.613123 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:45.614444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.614444 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.614444 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.614444 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.614444 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.614444 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:45.621457 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:08:45.625858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.625858 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.625858 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.625858 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.625858 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.625858 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:45.626306 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:08:45.628779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.628779 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.628779 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.628779 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.628779 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.628779 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:45.657357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.50.100,3260]
May 13 02:08:45.657357 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.50.100,3260] successful.
May 13 02:08:45.657357 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.675060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.675060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.40.100,3260]
May 13 02:08:45.675060 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.40.100,3260] successful.
May 13 02:08:45.675060 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.679383 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updated VIF entry in instance network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:08:45.679690 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:45.687080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.696198 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.696620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:45.696859 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:45.697012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:45.698314 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] HCTL ('10', '-', '-', 0) found on session 71 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:45.698438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.704111 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [70] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b0c2ab76-e111-4324-9048-e0e7ae09d2ce (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:08:45.707106 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:08:45.707884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:45.708004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:08:45.708791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] HCTL ('13', '-', '-', 0) found on session 72 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:08:45.708882 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:08:45.715461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching for a device in session 71 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:45.715691 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:45.727205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching for a device in session 72 and hctl ['13', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:45.820232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:45.875514 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:45.981241 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:46.076641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:08:46.077437 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:08:46.077664 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Creating image(s)
May 13 02:08:46.078197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:46.078364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:46.078815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:46.080055 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:46.085311 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:46.086176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:46.132201 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:08:46.164065 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:46.182205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e39db71c-ab05-4232-9f08-c48511abc09d req-215ed372-2f03-4588-8a5e-3c15ed2d37d0 service nova] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:46.199749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:46.200327 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:46.200900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:46.201641 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:46.206175 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:46.206679 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:46.294235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:46.294786 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:46.369374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk 1073741824" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:46.369714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:46.371448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:46.468556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:46.469149 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Checking if we can resize image /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:46.469419 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:46.564392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:46.565286 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Cannot resize image /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:46.565286 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:46.565431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Ensure instance console log exists: /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:46.566114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:46.566114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:46.566114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:46.642767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.873s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:46.644218 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:08:46.666332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-15b75d15-868f-40a2-984c-0ef5a9377484 req-e0cbd452-5762-4282-952b-988395956793 service nova] Releasing lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:46.667190 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquired lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:46.667508 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:46.726857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching for a device in session 72 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:08:46.727151 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:08:46.931287 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.000662149999925532 future=<Future at 0x705c6c12d700 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:46.931799 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Emitting event <LifecycleEvent: 1778638111.930516, 3234e5b7-40fb-4717-9c11-10e6a7739c6b => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:46.932042 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] VM Stopped (Lifecycle Event)
May 13 02:08:46.933222 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:47.151830 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:08:47.153117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:08:47.153589 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:47.153901 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:47.256255 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:47.338189 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b50ee8d4cf14f748970183486527866', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb844efc2d7146c3a8ccc339e7b86aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:08:47.434788 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: 3234e5b7-40fb-4717-9c11-10e6a7739c6b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:47.489658 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:47.523230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Found WWN 330000000be0ac26e for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:08:47.523712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:08:47.523871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000be0ac26e', 'path': '/dev/dm-1', 'multipath_id': '330000000be0ac26e'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:08:47.524000 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be0ac26e', 'path': '/dev/dm-1', 'multipath_id': '330000000be0ac26e'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:08:47.533264 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'flavor' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:47.657554 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:08:47.718564 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Updating instance_info_cache with network_info: [{"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:47.829745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.036761 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attempting to attach volume 75230db6-8513-4f57-aa91-7bdff1fcb9a5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:08:48.039194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:   <alias name="ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5"/>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:   <serial>75230db6-8513-4f57-aa91-7bdff1fcb9a5</serial>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]: </disk>
May 13 02:08:48.039194 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:08:48.166264 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Successfully created port: ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:08:48.168786 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:08:48.221343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Releasing lock "refresh_cache-988a4e39-d4a2-48d3-949e-f4d02dc2fc59" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:48.221849 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance network_info: |[{"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:08:48.223819 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Start _get_guest_xml network_info=[{"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:48.226498 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:48.227811 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1948847450', uuid='988a4e39-d4a2-48d3-949e-f4d02dc2fc59'), owner=OwnerMeta(userid='97a1ac6dead24ce08dfd2baf9d479723', username='tempest-VolumesActionsTest-1868975691-project-member', projectid='799fb53ee1a74401a96398c636f94fe2', projectname='tempest-VolumesActionsTest-1868975691'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638128.2273989) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:48.229376 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:48.229718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:48.232232 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:48.232430 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:48.233631 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:48.233999 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:48.234216 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:48.234359 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:48.234531 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:48.234651 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:48.234804 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:48.235010 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:48.235166 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:48.235322 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:48.235467 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:48.235624 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:48.252411 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948847450',display_name='tempest-VolumesActionsTest-instance-1948847450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1948847450',id=38,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-pjnqq924',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:45Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=988a4e39-d4a2-48d3-949e-f4d02dc2fc59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:48.252697 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:48.253536 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:48.254393 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lazy-loading 'pci_devices' on Instance uuid 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:48.759078 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <uuid>988a4e39-d4a2-48d3-949e-f4d02dc2fc59</uuid>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <name>instance-00000026</name>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesActionsTest-instance-1948847450</nova:name>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:48</nova:creationTime>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:user uuid="97a1ac6dead24ce08dfd2baf9d479723">tempest-VolumesActionsTest-1868975691-project-member</nova:user>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:project uuid="799fb53ee1a74401a96398c636f94fe2">tempest-VolumesActionsTest-1868975691</nova:project>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         <nova:port uuid="be505a25-4148-4a9b-89c3-b931bcd316a0">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="serial">988a4e39-d4a2-48d3-949e-f4d02dc2fc59</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="uuid">988a4e39-d4a2-48d3-949e-f4d02dc2fc59</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.config"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:3f:84:24"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <target dev="tapbe505a25-41"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/console.log" append="off"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:48.759078 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Preparing to wait for external event network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948847450',display_name='tempest-VolumesActionsTest-instance-1948847450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1948847450',id=38,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-pjnqq924',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:45Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=988a4e39-d4a2-48d3-949e-f4d02dc2fc59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:48.763799 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:48.766352 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.766352 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4738b916-0f07-51b2-bbca-287eb2458fa6', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:48.781077 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.783133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:48.788572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.788739 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe505a25-41, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:48.789470 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe505a25-41, col_values=(('qos', UUID('e4b33371-1f70-4ee2-8d23-b2521e64fd6f')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:48.789926 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe505a25-41, col_values=(('external_ids', {'iface-id': 'be505a25-4148-4a9b-89c3-b931bcd316a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:84:24', 'vm-uuid': '988a4e39-d4a2-48d3-949e-f4d02dc2fc59'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:48.790727 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.793851 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:48.801838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:48.803112 np0000000663 nova-compute[98103]: INFO os_vif [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41')
May 13 02:08:48.901452 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Successfully updated port: ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:08:48.960911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-changed-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:48.961453 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Refreshing instance network info cache due to event network-changed-ff0b550f-2038-4e06-8f38-4d8e5a067aa0. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:08:48.961656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] Acquiring lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:48.961764 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] Acquired lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:48.962229 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Refreshing network info cache for port ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:08:49.181977 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:08:49.183175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:08:49.183576 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Creating image(s)
May 13 02:08:49.184567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:49.184567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:49.184904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:49.185521 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:49.189407 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:49.191207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:49.315056 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.123s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:49.318146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:49.319424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:49.319913 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:49.323634 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:49.324207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:49.409215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:49.429011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:49.429470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:49.465819 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:49.501852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk 1073741824" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:49.502053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:49.502380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:49.564040 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:49.618444 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:49.619087 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:08:49.619410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:49.724388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:49.726473 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Cannot resize image /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:08:49.726985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:49.727379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Ensure instance console log exists: /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:08:49.731122 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:49.733493 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:49.733824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:49.734071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:49.763558 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:49.764502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:49.764502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:49.764502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:de:c2:09, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:50.235202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c880e2f1-8275-45e5-bb53-a56a1811e067 req-b9fb754d-de91-4d7e-85bb-1221210a29be service nova] Releasing lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:50.236061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquired lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:50.237163 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:50.327887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:50.327887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:50.328777 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] No VIF found with MAC fa:16:3e:3f:84:24, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:50.329313 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Using config drive
May 13 02:08:50.461550 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:50.815320 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:08:50.836250 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:51.004460 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Creating config drive at /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.config
May 13 02:08:51.007597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1y0v6ij8 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:51.062887 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:51.072539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1y0v6ij8" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:51.224176 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Updating instance_info_cache with network_info: [{"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:51.331874 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e261cf79-6b7e-440f-a8ed-c5a8e95a3460 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.574s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:51.581272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.616270 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.727164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Releasing lock "refresh_cache-5e23d5ee-dee0-45b8-a527-4efd1b220ac7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:51.727595 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance network_info: |[{"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:08:51.728669 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.730487 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Start _get_guest_xml network_info=[{"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:51.740795 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:51.742206 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-221093023', uuid='5e23d5ee-dee0-45b8-a527-4efd1b220ac7'), owner=OwnerMeta(userid='5b50ee8d4cf14f748970183486527866', username='tempest-VolumesNegativeTest-1483049422-project-member', projectid='bb844efc2d7146c3a8ccc339e7b86aca', projectname='tempest-VolumesNegativeTest-1483049422'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638131.7417753) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:51.746686 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:51.747051 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:51.748737 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:51.749046 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:51.753080 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:51.770631 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-221093023',display_name='tempest-VolumesNegativeTest-instance-221093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesnegativetest-instance-221093023',id=39,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb844efc2d7146c3a8ccc339e7b86aca',ramdisk_id='',reservation_id='r-acdz007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1483049422',owner_user_name='tempest-VolumesNegativeTest-1483049422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:48Z,user_data=None,user_id='5b50ee8d4cf14f748970183486527866',uuid=5e23d5ee-dee0-45b8-a527-4efd1b220ac7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:51.771270 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converting VIF {"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:51.773070 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:51.774587 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:51.829325 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2a13bc44-898f-409e-9907-b2587d1d57bd req-65d2e979-95d8-41c4-a0ed-43b9f99cbf57 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:51.829978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2a13bc44-898f-409e-9907-b2587d1d57bd req-65d2e979-95d8-41c4-a0ed-43b9f99cbf57 service nova] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:51.830180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2a13bc44-898f-409e-9907-b2587d1d57bd req-65d2e979-95d8-41c4-a0ed-43b9f99cbf57 service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:51.830428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2a13bc44-898f-409e-9907-b2587d1d57bd req-65d2e979-95d8-41c4-a0ed-43b9f99cbf57 service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:51.830690 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2a13bc44-898f-409e-9907-b2587d1d57bd req-65d2e979-95d8-41c4-a0ed-43b9f99cbf57 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Processing event network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:51.901460 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Rescuing
May 13 02:08:51.903774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:08:51.903774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:08:51.903774 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:08:51.947439 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.949596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.952379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:51.978598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <uuid>5e23d5ee-dee0-45b8-a527-4efd1b220ac7</uuid>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <name>instance-00000027</name>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesNegativeTest-instance-221093023</nova:name>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:51</nova:creationTime>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:user uuid="5b50ee8d4cf14f748970183486527866">tempest-VolumesNegativeTest-1483049422-project-member</nova:user>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:project uuid="bb844efc2d7146c3a8ccc339e7b86aca">tempest-VolumesNegativeTest-1483049422</nova:project>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         <nova:port uuid="ff0b550f-2038-4e06-8f38-4d8e5a067aa0">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="192.168.233.156" ipVersion="4"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="serial">5e23d5ee-dee0-45b8-a527-4efd1b220ac7</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="uuid">5e23d5ee-dee0-45b8-a527-4efd1b220ac7</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.config"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:d2:d7:a9"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <target dev="tapff0b550f-20"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/console.log" append="off"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:52.279966 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Preparing to wait for external event network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:52.279966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-221093023',display_name='tempest-VolumesNegativeTest-instance-221093023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesnegativetest-instance-221093023',id=39,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb844efc2d7146c3a8ccc339e7b86aca',ramdisk_id='',reservation_id='r-acdz007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1483049422',owner_user_name='tempest-VolumesNegativeTest-1483049422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:48Z,user_data=None,user_id='5b50ee8d4cf14f748970183486527866',uuid=5e23d5ee-dee0-45b8-a527-4efd1b220ac7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converting VIF {"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.282398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:52.282719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:08:52.284632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.284632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4983c4aa-d22a-5acd-8305-d105daaba5db', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:52.294585 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.295562 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:52.295884 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.301378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.301378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff0b550f-20, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:52.301825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff0b550f-20, col_values=(('qos', UUID('443a1771-b391-4408-8939-0c463a327ee7')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:52.302079 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff0b550f-20, col_values=(('external_ids', {'iface-id': 'ff0b550f-2038-4e06-8f38-4d8e5a067aa0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:d7:a9', 'vm-uuid': '5e23d5ee-dee0-45b8-a527-4efd1b220ac7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:52.305451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.306871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:52.315723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:52.316690 np0000000663 nova-compute[98103]: INFO os_vif [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20')
May 13 02:08:52.408409 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:52.580659 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638132.578392, 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:52.580659 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] VM Started (Lifecycle Event)
May 13 02:08:52.585422 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:52.593360 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:52.597950 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance spawned successfully.
May 13 02:08:52.598328 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:52.834318 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:53.016337 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:53.091115 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:53.093645 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:53.112077 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.112249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.113316 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.113609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.113913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.114442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:53.519175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:08:53.599438 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:53.599438 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638133.5980039, 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:53.599438 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] VM Paused (Lifecycle Event)
May 13 02:08:53.622757 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Took 7.55 seconds to spawn the instance on the hypervisor.
May 13 02:08:53.623032 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:53.844740 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:53.845751 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:08:53.845751 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] No VIF found with MAC fa:16:3e:d2:d7:a9, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:08:53.845898 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Using config drive
May 13 02:08:53.908683 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:53.908883 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:53.909152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:53.909789 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:53.910014 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] No waiting events found dispatching network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:53.910184 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7eca95f2-7c92-43e5-a9ee-1976d562f41b req-4b845d96-d835-407f-af88-03fc64938d67 service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received unexpected event network-vif-plugged-be505a25-4148-4a9b-89c3-b931bcd316a0 for instance with vm_state active and task_state None.
May 13 02:08:54.101783 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:54.106684 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638134.1062758, 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:54.109684 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] VM Resumed (Lifecycle Event)
May 13 02:08:54.136707 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Took 13.35 seconds to build instance.
May 13 02:08:54.355052 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:54.544579 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Creating config drive at /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.config
May 13 02:08:54.550349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_cffltmj {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:54.610821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:54.618052 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:54.622200 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_cffltmj" returned: 0 in 0.071s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:54.640325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.859s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:55.102605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.182647 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.192258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.196592 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.225172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.265445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.434345 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-652eb773-f670-4ee0-a847-4d52e692715b req-77fe096b-f8b2-4e78-b32d-0895453e8993 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:55.436607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-652eb773-f670-4ee0-a847-4d52e692715b req-77fe096b-f8b2-4e78-b32d-0895453e8993 service nova] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:55.436901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-652eb773-f670-4ee0-a847-4d52e692715b req-77fe096b-f8b2-4e78-b32d-0895453e8993 service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:55.437015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-652eb773-f670-4ee0-a847-4d52e692715b req-77fe096b-f8b2-4e78-b32d-0895453e8993 service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:55.437560 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-652eb773-f670-4ee0-a847-4d52e692715b req-77fe096b-f8b2-4e78-b32d-0895453e8993 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Processing event network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:08:55.464241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.521474 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.537339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.544320 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.556576 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99965879499996 future=<Future at 0x705c8017cec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:55.559156 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997882844999822 future=<Future at 0x705c8017cec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:55.559210 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997175710999954 future=<Future at 0x705c8017cec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:55.566782 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance destroyed successfully.
May 13 02:08:55.567585 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'numa_topology' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:55.571839 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.582958 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.822754 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.829899 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:55.981823 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:55.982033 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:55.982202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:55.982339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:55.982461 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:55.982627 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state active and task_state rescuing.
May 13 02:08:55.982735 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:55.982852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:55.984011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:55.984138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:55.984282 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:55.984411 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-004817a7-fb8b-43c9-af5f-6c2d9cdf65bc req-5a1b4c22-a612-4895-8dff-69a49e2689f6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state active and task_state rescuing.
May 13 02:08:56.074294 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attempting rescue
May 13 02:08:56.075284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:08:56.083043 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:08:56.083219 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Creating image(s)
May 13 02:08:56.084007 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:56.084233 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:56.084939 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:56.086252 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'trusted_certs' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:56.198926 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638136.198484, 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:56.199686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:08:56.200045 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] VM Started (Lifecycle Event)
May 13 02:08:56.203441 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:08:56.210242 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance spawned successfully.
May 13 02:08:56.212418 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:08:56.588630 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:56.589317 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:56.593552 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:56.596804 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:56.597387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:56.597818 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:56.602271 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:08:56.602712 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:56.705959 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:56.716326 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:56.724056 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:56.725966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.754125 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:08:56.798628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue" returned: 0 in 0.073s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:08:56.799482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:56.800117 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'migration_context' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:56.834956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:56.835238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:56.835480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:56.835661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:56.835888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:56.845222 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Terminating instance
May 13 02:08:57.221853 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:08:57.222557 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638137.2220507, 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:57.222557 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] VM Paused (Lifecycle Event)
May 13 02:08:57.262206 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Took 8.08 seconds to spawn the instance on the hypervisor.
May 13 02:08:57.263135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:57.303666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.306448 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:57.307153 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:08:57.307665 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start _get_guest_xml network_info=[{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:de:c2:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:08:57.307956 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:57.350147 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:08:57.380622 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.386437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.399081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.404529 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.424593 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.436249 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:57.533670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:57.534270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:57.534466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:57.534630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:57.534843 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] No waiting events found dispatching network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:57.535032 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e355014a-f00a-4daf-9c66-9751e8ac8ae8 req-77ea618e-b400-4c48-807c-36b7c1ea604c service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received unexpected event network-vif-plugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 for instance with vm_state active and task_state None.
May 13 02:08:57.693635 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Instance destroyed successfully.
May 13 02:08:57.694330 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lazy-loading 'resources' on Instance uuid 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:57.725028 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:57.727189 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638137.7269895, 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:08:57.727311 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] VM Resumed (Lifecycle Event)
May 13 02:08:57.778817 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Took 14.07 seconds to build instance.
May 13 02:08:57.810240 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:57.813702 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:08:57.816701 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-227258032', uuid='b6762a47-e412-4488-a878-420fb31d8b76'), owner=OwnerMeta(userid='c1cf7b3eb74a47aca33e0d7fc78c7b0e', username='tempest-ServerRescueNegativeTestJSON-1325017662-project-member', projectid='2c88a2c430e64df18a80e42983f49a4b', projectname='tempest-ServerRescueNegativeTestJSON-1325017662'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:de:c2:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638137.8161952) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:08:57.819536 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:08:57.820056 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:08:57.821491 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:08:57.821774 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:08:57.822995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:08:57.823473 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:08:57.824733 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:08:57.824980 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:08:57.825222 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:08:57.825372 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:08:57.825501 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:08:57.825688 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:08:57.825814 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:08:57.825967 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:08:57.826101 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:08:57.826263 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:08:57.826439 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'vcpu_model' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:58.081312 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] No waiting events found dispatching network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:58.084922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Acquiring lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:58.085252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:58.085252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:58.085252 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] No waiting events found dispatching network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:08:58.085444 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d94931f-788e-440e-9c3c-faa273238430 req-ff1f3304-8fea-4775-9e21-da1265dbdeee service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-unplugged-be505a25-4148-4a9b-89c3-b931bcd316a0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:08:58.196762 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1948847450',display_name='tempest-VolumesActionsTest-instance-1948847450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1948847450',id=38,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799fb53ee1a74401a96398c636f94fe2',ramdisk_id='',reservation_id='r-pjnqq924',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1868975691',owner_user_name='tempest-VolumesActionsTest-1868975691-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:08:54Z,user_data=None,user_id='97a1ac6dead24ce08dfd2baf9d479723',uuid=988a4e39-d4a2-48d3-949e-f4d02dc2fc59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:08:58.197040 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converting VIF {"id": "be505a25-4148-4a9b-89c3-b931bcd316a0", "address": "fa:16:3e:3f:84:24", "network": {"id": "0219df57-7a6d-4a0b-ada1-f760459ff185", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1332979617-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "799fb53ee1a74401a96398c636f94fe2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe505a25-41", "ovs_interfaceid": "be505a25-4148-4a9b-89c3-b931bcd316a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:58.197571 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:58.197779 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:08:58.199424 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.199587 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe505a25-41, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:58.200754 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.201584 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:58.207948 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.208998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.209195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4b33371-1f70-4ee2-8d23-b2521e64fd6f) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:08:58.211024 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.211024 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:08:58.217448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.220695 np0000000663 nova-compute[98103]: INFO os_vif [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:84:24,bridge_name='br-int',has_traffic_filtering=True,id=be505a25-4148-4a9b-89c3-b931bcd316a0,network=Network(0219df57-7a6d-4a0b-ada1-f760459ff185),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe505a25-41')
May 13 02:08:58.221037 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Deleting instance files /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59_del
May 13 02:08:58.221811 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Deletion of /opt/stack/data/nova/instances/988a4e39-d4a2-48d3-949e-f4d02dc2fc59_del complete
May 13 02:08:58.236849 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:08:58.242344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:08:58.280796 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2536d16-10b5-41ff-b0ef-51ef24b35fd2 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.576s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:58.328829 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:58.340635 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-227258032',display_name='tempest-ServerRescueNegativeTestJSON-server-227258032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-227258032',id=34,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEBKHNXwFCXl4plP0qcZWYfEK8yfMpHcT9D/zE/pNWrpGxnBWvXitYaZCdQYPOltZRyszM1VcrRh+y6pRi0JKKJ6F1KjcjInD3jSfCBoool3+NRmmkxSJeCbr2zr7j1yQ==',key_name='tempest-keypair-316346649',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-e3kj90ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:08:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=b6762a47-e412-4488-a878-420fb31d8b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:de:c2:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:08:58.341618 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "vif_mac": "fa:16:3e:de:c2:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:08:58.342284 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:08:58.342963 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'pci_devices' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:58.524489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:58.729794 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 02:08:58.730387 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:08:58.730557 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:08:58.730651 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:08:58.730828 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:58.739424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:58.739609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:58.739743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:08:58.739866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:08:58.739997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:08:58.742625 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Terminating instance
May 13 02:08:58.746671 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 02:08:58.746978 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999852886000099 future=<Future at 0x705c486d6180 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:58.799358 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:08:58.845475 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:08:58.846565 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] End _get_guest_xml xml=<domain type="qemu">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <uuid>b6762a47-e412-4488-a878-420fb31d8b76</uuid>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <name>instance-00000022</name>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-227258032</nova:name>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:08:57</nova:creationTime>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:user uuid="c1cf7b3eb74a47aca33e0d7fc78c7b0e">tempest-ServerRescueNegativeTestJSON-1325017662-project-member</nova:user>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:project uuid="2c88a2c430e64df18a80e42983f49a4b">tempest-ServerRescueNegativeTestJSON-1325017662</nova:project>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         <nova:port uuid="533aa486-0d6c-4235-91bf-8e888684516d">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <system>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="serial">b6762a47-e412-4488-a878-420fb31d8b76</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="uuid">b6762a47-e412-4488-a878-420fb31d8b76</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </system>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <os>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </os>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <features>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </features>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   <devices>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config.rescue"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </disk>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:de:c2:09"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <target dev="tap533aa486-0d"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </interface>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/console.log" append="off"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </serial>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <video>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </video>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </rng>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:   </devices>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]: </domain>
May 13 02:08:58.846565 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:08:58.856639 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance destroyed successfully.
May 13 02:08:59.251149 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:08:59.283348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:59.289514 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:59.317222 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:59.328013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:59.369171 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:08:59.610727 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999674885999866 future=<Future at 0x705c80105100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:08:59.613918 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Instance destroyed successfully.
May 13 02:08:59.615373 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lazy-loading 'resources' on Instance uuid 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:08:59.632004 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3cff4722-9682-4ccc-8c15-d76cc6218105 req-40fb2981-3b97-4df9-9263-6abe7565b14f service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Received event network-vif-deleted-be505a25-4148-4a9b-89c3-b931bcd316a0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:08:59.634309 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-3cff4722-9682-4ccc-8c15-d76cc6218105 req-40fb2981-3b97-4df9-9263-6abe7565b14f service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Neutron deleted interface be505a25-4148-4a9b-89c3-b931bcd316a0; detaching it from the instance and deleting it from the info cache
May 13 02:08:59.634309 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3cff4722-9682-4ccc-8c15-d76cc6218105 req-40fb2981-3b97-4df9-9263-6abe7565b14f service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:08:59.886966 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:00.118001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-221093023',display_name='tempest-VolumesNegativeTest-instance-221093023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesnegativetest-instance-221093023',id=39,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:57Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb844efc2d7146c3a8ccc339e7b86aca',ramdisk_id='',reservation_id='r-acdz007f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1483049422',owner_user_name='tempest-VolumesNegativeTest-1483049422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:08:57Z,user_data=None,user_id='5b50ee8d4cf14f748970183486527866',uuid=5e23d5ee-dee0-45b8-a527-4efd1b220ac7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:09:00.118318 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converting VIF {"id": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "address": "fa:16:3e:d2:d7:a9", "network": {"id": "f9c8887c-9b44-4787-bfb8-db8b6d7f2948", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.156", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4f893ea06521473e932cf414ddb173aa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapff0b550f-20", "ovs_interfaceid": "ff0b550f-2038-4e06-8f38-4d8e5a067aa0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:00.118788 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:00.119019 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:09:00.119968 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.120229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff0b550f-20, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:00.133808 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.134770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:00.137903 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3cff4722-9682-4ccc-8c15-d76cc6218105 req-40fb2981-3b97-4df9-9263-6abe7565b14f service nova] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Detach interface failed, port_id=be505a25-4148-4a9b-89c3-b931bcd316a0, reason: Instance 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:09:00.141128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.142341 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.142532 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=443a1771-b391-4408-8939-0c463a327ee7) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:00.143987 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.144705 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:00.149328 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.152827 np0000000663 nova-compute[98103]: INFO os_vif [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:d7:a9,bridge_name='br-int',has_traffic_filtering=True,id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0,network=Network(f9c8887c-9b44-4787-bfb8-db8b6d7f2948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff0b550f-20')
May 13 02:09:00.154173 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Deleting instance files /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7_del
May 13 02:09:00.156260 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Deletion of /opt/stack/data/nova/instances/5e23d5ee-dee0-45b8-a527-4efd1b220ac7_del complete
May 13 02:09:00.361735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.387783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:00.387996 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:00.388176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:00.388342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] No VIF found with MAC fa:16:3e:de:c2:09, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:00.388969 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Took 1.66 seconds to deallocate network for instance.
May 13 02:09:00.389888 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Using config drive
May 13 02:09:00.467601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:00.669558 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 02:09:00.670196 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:09:00.670517 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:09:00.670831 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:09:00.670831 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:00.750112 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:00.898361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:00.898361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:00.899522 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'ec2_ids' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:01.113801 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b7f3094-d932-48e8-975e-467724034206 req-a362f31b-dca4-4c3a-8d17-2e55b7987d76 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-deleted-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:01.114996 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-2b7f3094-d932-48e8-975e-467724034206 req-a362f31b-dca4-4c3a-8d17-2e55b7987d76 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Neutron deleted interface ff0b550f-2038-4e06-8f38-4d8e5a067aa0; detaching it from the instance and deleting it from the info cache
May 13 02:09:01.114996 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2b7f3094-d932-48e8-975e-467724034206 req-a362f31b-dca4-4c3a-8d17-2e55b7987d76 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:01.410776 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:01.411194 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'keypairs' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:01.553238 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:01.619228 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b7f3094-d932-48e8-975e-467724034206 req-a362f31b-dca4-4c3a-8d17-2e55b7987d76 service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Detach interface failed, port_id=ff0b550f-2038-4e06-8f38-4d8e5a067aa0, reason: Instance 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:09:01.757830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:01.758134 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:01.803170 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:01.803812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:01.804021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:01.804166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:01.804941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] No waiting events found dispatching network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:01.804941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:09:01.805060 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:01.805238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Acquiring lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:01.805375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:01.805498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:01.805746 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] No waiting events found dispatching network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:01.805746 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01eb1861-7e9d-4962-849e-f083b8522e89 req-7e648976-28b8-4154-8b2f-dde01c7de20e service nova] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Received event network-vif-unplugged-ff0b550f-2038-4e06-8f38-4d8e5a067aa0 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:09:01.917131 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:01.918618 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:02.055592 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Took 1.38 seconds to deallocate network for instance.
May 13 02:09:02.075393 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Creating config drive at /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config.rescue
May 13 02:09:02.079701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9_b_yb9 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:02.154252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc9_b_yb9" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:02.261401 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:02.566130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:02.698913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.730954 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.736412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.772509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.874s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:02.779581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.210s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:02.832385 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.876039 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Deleted allocations for instance 988a4e39-d4a2-48d3-949e-f4d02dc2fc59
May 13 02:09:02.878515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.879707 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:02.957638 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:02.957922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:02.958247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:02.958354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:02.958526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:02.958678 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8a1ffe2b-e6ba-4770-9764-5411e5021fb5 req-526d3f14-719f-4fdb-9d70-65b3bb55b76c service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state active and task_state rescuing.
May 13 02:09:03.502695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:03.503033 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:03.733030 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for b6762a47-e412-4488-a878-420fb31d8b76 due to new event <LifecycleEvent: 1778638143.7326849, b6762a47-e412-4488-a878-420fb31d8b76 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:09:03.733505 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638143.7326849, b6762a47-e412-4488-a878-420fb31d8b76 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:03.733505 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Resumed (Lifecycle Event)
May 13 02:09:03.738143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4aacb7e4-bbd0-4878-ba0f-53d62f677a78 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:03.748425 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.750028 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.750320 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.750517 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.750798 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.751065 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.751282 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.751452 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:09:03.751684 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:03.879055 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:03.879388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:03.894992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-71d0e16b-a7c0-4054-8140-fe9e01157a01 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Lock "988a4e39-d4a2-48d3-949e-f4d02dc2fc59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.060s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:04.007314 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:04.253036 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:04.257568 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:04.262036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:04.382662 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:09:04.517724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.742s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:04.520280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.256s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:04.520610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:04.521864 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:09:04.589511 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Deleted allocations for instance 5e23d5ee-dee0-45b8-a527-4efd1b220ac7
May 13 02:09:04.759754 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638144.7594872, b6762a47-e412-4488-a878-420fb31d8b76 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:04.760492 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Started (Lifecycle Event)
May 13 02:09:04.860039 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Stashing vm_state: active {{(pid=98103) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 13 02:09:04.970603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:04.970848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:04.974522 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:09:04.974712 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Claim successful on node np0000000663
May 13 02:09:05.040195 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:05.040676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:05.040676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:05.040879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:05.041118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:05.041246 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3a7f3f4a-43df-44e1-8799-a521a7092a6f req-c536fdff-cf28-4121-bde0-5ea788c6a94a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state None.
May 13 02:09:05.145131 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:05.262936 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:05.265178 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:05.432839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:05.472019 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:05.593225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:05.625782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-62eac2f3-e606-4427-a8ab-c22a50f6cd22 tempest-VolumesNegativeTest-1483049422 tempest-VolumesNegativeTest-1483049422-project-member] Lock "5e23d5ee-dee0-45b8-a527-4efd1b220ac7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.885s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:05.748210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:05.748771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:05.875469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:05.878696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:05.926574 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Unrescuing
May 13 02:09:05.926758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:05.926956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:05.927255 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:05.988436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:05.992122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.105871 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.115226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.208773 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.209592 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.335445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.338777 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:06.344754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.438437 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:06.466735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue --force-share --output=json" returned: 0 in 0.122s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.467522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.595446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.596469 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:06.602431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.728678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.729246 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.849800 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.857122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:06.986260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:06.986769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.037164 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:07.043985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:07.045442 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:07.211012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.215175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.250478 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:07.359115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.359115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.452219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.457484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.552019 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.552509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.569698 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:07.658396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.664529 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.760184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:07.761108 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'flavor' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:07.784680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.785252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:07.911357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:07.911528 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:07.919001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:07.922375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:08.055500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:08.055500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:08.089181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.116s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:08.092117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.657s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:08.099130 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:09:08.180557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:08.181500 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:08.183167 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:08.231606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:08.232186 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=11085MB free_disk=74.15919876098633GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:09:08.232426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:08.307161 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.311715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.342480 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.487811 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.494753 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.550193 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:08.550453 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:08.550839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:08.550923 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:08.551126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:08.551865 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-1012f9f3-bf32-4157-9969-e5d474036142 req-95552804-73bd-4271-ba5e-48074a2e1f3a service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:08.611542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.637482 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:09:08.639653 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:09:08.639653 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:08.640914 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:08.654813 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:09:08.659078 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.661362 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Claim successful on node np0000000663
May 13 02:09:08.666429 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.991093167000145 future=<Future at 0x705c487a8950 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:08.670557 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.681113 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance destroyed successfully.
May 13 02:09:08.681781 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'numa_topology' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:08.692623 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.822218 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfb6eb488f574f7c8f932d1d10c62d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b11777492cc476fb87a83ff007dc8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:09:08.826829 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:08.833517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.014045 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.020525 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.157025 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:09:09.183225 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating resource usage from migration 908550e4-1b50-42e5-ab79-c6f401f43182
May 13 02:09:09.188603 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Object Instance<b6762a47-e412-4488-a878-420fb31d8b76> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:09.660394 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:09:09.709231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.750238 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.837300 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.869067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.906770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:09.908985 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:10.050494 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:10.051425 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:10.094487 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Successfully created port: b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:09:10.145793 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:10.476853 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:10.554872 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:10.560932 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00549409000018386 future=<Future at 0x705c8017cec0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:10.561571 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:10.562070 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.1851083560000006 future=<Future at 0x705c486d6180 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:10.562800 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.1840134409999337 future=<Future at 0x705c486d6180 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:10.672796 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:09:10.674797 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:09:10.676959 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Creating image(s)
May 13 02:09:10.677768 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.678771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.678771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.681106 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:10.686470 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.686651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.699965 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.700702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.700702 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:10.701380 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.701936 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.701936 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.702694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.702694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.702694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.702694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.703043 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.703220 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.703377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.703547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.703676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.703805 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.703949 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.704075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.704299 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.704483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.704601 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.704723 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.704846 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.704982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.709728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:10.709978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.710485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.710485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.710485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.710617 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.710780 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:10.710959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.711153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.713703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:10.713906 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:10.714054 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e62da335-9dfe-4f5e-ac0e-4bff16800051 req-6a16ce59-925c-4a9b-938f-6c9265e17dc6 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state rescued and task_state unrescuing.
May 13 02:09:10.850408 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.144s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:10.850927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:10.854535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:10.857255 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:10.865805 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:10.866345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:10.895721 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-36d470f3-1690-4db8-b161-ad987b5f1a68 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:10.896872 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for b6762a47-e412-4488-a878-420fb31d8b76 due to new event <LifecycleEvent: 1778638150.8963323, b6762a47-e412-4488-a878-420fb31d8b76 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:09:10.897278 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638150.8963323, b6762a47-e412-4488-a878-420fb31d8b76 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:10.897511 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Resumed (Lifecycle Event)
May 13 02:09:10.996702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.130s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:10.998013 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:11.071936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.982s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:11.077067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.840s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:11.080118 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Migrating
May 13 02:09:11.085580 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:09:11.113310 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk 1073741824" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:11.127124 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:11.135369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:11.272878 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.137s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:11.276984 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:09:11.276984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:11.396831 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Successfully updated port: b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:09:11.405167 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:11.413552 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:11.445087 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:11.445087 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Cannot resize image /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:09:11.445087 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:09:11.445317 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Ensure instance console log exists: /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:09:11.447428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:11.448271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:11.448469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:11.692074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:11.692074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:11.692074 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:11.915954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:11.915954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquired lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:11.915954 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:11.925126 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638151.9224136, b6762a47-e412-4488-a878-420fb31d8b76 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:11.925632 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Started (Lifecycle Event)
May 13 02:09:12.136525 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Applying migration context for instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 as it has an incoming, in-progress migration 908550e4-1b50-42e5-ab79-c6f401f43182. Migration status is pre-migrating {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 13 02:09:12.140346 np0000000663 nova-compute[98103]: INFO nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating resource usage from migration 908550e4-1b50-42e5-ab79-c6f401f43182
May 13 02:09:12.194792 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:12.214600 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.214600 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.217146 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.217146 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 86e04c9b-9512-47f6-8849-2c171e65ea18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.217461 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 12c32a90-8f0e-4a43-b818-c86882b54d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.217754 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b6762a47-e412-4488-a878-420fb31d8b76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.218569 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.218973 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.218973 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.219049 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.219206 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Migration 908550e4-1b50-42e5-ab79-c6f401f43182 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 13 02:09:12.219316 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:09:12.219986 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:09:12.219986 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2944MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:09:08 up 33 min,  2 users,  load average: 8.23, 7.07, 3.83\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '9', 'num_os_type_None': '11', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '5', 'io_workload': '2', 'num_proj_2c88a2c430e64df18a80e42983f49a4b': '3', 'num_vm_rescued': '1', 'num_task_resize_prep': '1', 'num_proj_89cd0ac04b144296b82948ab2abe19a8': '1', 'num_proj_635951473383437bbabc3b1bb776416a': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_8b11777492cc476fb87a83ff007dc8b9': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:09:12.432944 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:12.443792 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:12.535840 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:09:12.774675 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:12.850821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:12.850821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:12.851063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:12.851223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:12.853485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:12.853485 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received unexpected event network-vif-plugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with vm_state active and task_state None.
May 13 02:09:12.853485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-changed-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:12.853485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Refreshing instance network info cache due to event network-changed-b6591ce3-f1f9-4189-8cad-807133fd2e27. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:12.853485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Acquiring lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:12.867312 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:13.048900 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:13.119118 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating instance_info_cache with network_info: [{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:13.275831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:13.276457 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:13.562053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:13.627467 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Releasing lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:13.628787 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Instance network_info: |[{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:09:13.630284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Start _get_guest_xml network_info=[{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:09:13.631264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Acquired lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:13.631264 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Refreshing network info cache for port b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:13.640318 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:13.644803 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-2081565242', uuid='4f97648c-78f1-459b-8dcb-c3d6573fb800'), owner=OwnerMeta(userid='bfb6eb488f574f7c8f932d1d10c62d47', username='tempest-VolumesBackupsTest-925143098-project-member', projectid='8b11777492cc476fb87a83ff007dc8b9', projectname='tempest-VolumesBackupsTest-925143098'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638153.6442564) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:09:13.646667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:09:13.647065 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:09:13.648668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:09:13.648924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:09:13.649973 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:09:13.650278 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:09:13.650598 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:09:13.650598 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:09:13.650819 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:09:13.651046 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:09:13.651046 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:09:13.651369 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:09:13.651490 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:09:13.651681 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:09:13.651836 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:09:13.652133 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:09:13.669978 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2081565242',display_name='tempest-VolumesBackupsTest-instance-2081565242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-2081565242',id=40,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOxesDf5shc/dm64nP+QaPLk5NTmRPbHScnTuOUwt/2bpy0N6IaTEVgWkmCpFAmkFvoWoIdaAh+5ucsm+7SYKuqUs5g6xTVy0IGMNNBsvZXY/0WSdv2fVTBYJNwQOZ0Ug==',key_name='tempest-keypair-2033583975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-fc782h5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=4f97648c-78f1-459b-8dcb-c3d6573fb800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:09:13.670564 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:13.672896 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:13.674964 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:13.748038 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0008256270000401855 future=<Future at 0x705c486d6180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:13.748038 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:13.748038 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.8622943599998507 future=<Future at 0x705c80105100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:13.748038 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.8621777129999373 future=<Future at 0x705c80105100 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:13.748684 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Emitting event <LifecycleEvent: 1778638138.7467353, 988a4e39-d4a2-48d3-949e-f4d02dc2fc59 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:13.748909 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] VM Stopped (Lifecycle Event)
May 13 02:09:13.780744 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:14.135381 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:14.180028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] End _get_guest_xml xml=<domain type="qemu">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <uuid>4f97648c-78f1-459b-8dcb-c3d6573fb800</uuid>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <name>instance-00000028</name>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesBackupsTest-instance-2081565242</nova:name>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:09:13</nova:creationTime>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:user uuid="bfb6eb488f574f7c8f932d1d10c62d47">tempest-VolumesBackupsTest-925143098-project-member</nova:user>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:project uuid="8b11777492cc476fb87a83ff007dc8b9">tempest-VolumesBackupsTest-925143098</nova:project>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         <nova:port uuid="b6591ce3-f1f9-4189-8cad-807133fd2e27">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <system>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="serial">4f97648c-78f1-459b-8dcb-c3d6573fb800</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="uuid">4f97648c-78f1-459b-8dcb-c3d6573fb800</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </system>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <os>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </os>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <features>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </features>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   <devices>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.config"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:0e:aa:17"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <target dev="tapb6591ce3-f1"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </interface>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/console.log" append="off"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </serial>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <video>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </video>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </rng>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:   </devices>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]: </domain>
May 13 02:09:14.180028 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Preparing to wait for external event network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2081565242',display_name='tempest-VolumesBackupsTest-instance-2081565242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-2081565242',id=40,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOxesDf5shc/dm64nP+QaPLk5NTmRPbHScnTuOUwt/2bpy0N6IaTEVgWkmCpFAmkFvoWoIdaAh+5ucsm+7SYKuqUs5g6xTVy0IGMNNBsvZXY/0WSdv2fVTBYJNwQOZ0Ug==',key_name='tempest-keypair-2033583975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-fc782h5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=4f97648c-78f1-459b-8dcb-c3d6573fb800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:14.182742 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:09:14.185342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.185425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:14.186072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:09:14.187289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.187289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e33d2350-8ddf-501d-8f7d-9c0c21c2aa10', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:14.188380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.188993 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:14.191939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.196317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.197315 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6591ce3-f1, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:14.198255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6591ce3-f1, col_values=(('qos', UUID('46b655fa-4a2d-482a-9bc2-1e480f345653')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:14.198576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6591ce3-f1, col_values=(('external_ids', {'iface-id': 'b6591ce3-f1f9-4189-8cad-807133fd2e27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:aa:17', 'vm-uuid': '4f97648c-78f1-459b-8dcb-c3d6573fb800'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:14.200532 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.203015 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:14.217819 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:14.217819 np0000000663 nova-compute[98103]: INFO os_vif [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1')
May 13 02:09:14.254133 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf48fb9-dac0-4369-9b7e-89b734eacccf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 988a4e39-d4a2-48d3-949e-f4d02dc2fc59] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:14.308448 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:09:14.308448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.236s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:14.308448 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 36.58 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:09:14.610673 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004403550001370604 future=<Future at 0x705c80105100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:14.610831 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:14.611005 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.046489475000044 future=<Future at 0x705c487a8950 state=cancelled>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:14.611615 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.046355186000028 future=<Future at 0x705c487a8950 state=cancelled>) was cancelled while queued, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:14.611615 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:14.619312 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638139.6101425, 5e23d5ee-dee0-45b8-a527-4efd1b220ac7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:14.619312 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] VM Stopped (Lifecycle Event)
May 13 02:09:14.704605 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:14.931450 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updated VIF entry in instance network info cache for port b6591ce3-f1f9-4189-8cad-807133fd2e27. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:14.933344 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating instance_info_cache with network_info: [{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:14.987951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-changed-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:14.988512 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing instance network info cache due to event network-changed-533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:14.988512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:14.988713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:14.989295 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:15.077032 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Starting migrate_disk_and_power_off {{(pid=98103) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 13 02:09:15.119635 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.121943 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 5e23d5ee-dee0-45b8-a527-4efd1b220ac7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:15.124542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.153279 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.307368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.321149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.394602 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:15.395507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:15.395507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:15.395675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:15.396290 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:15.396290 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c471f2a6-e150-40ac-a54f-d4f641f150fd req-563e1836-58a8-4357-80de-2528c6a74f73 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received unexpected event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with vm_state active and task_state resize_migrating.
May 13 02:09:15.438052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2b5a8bda-dd42-4be6-bc3b-822397b7c91e req-f8ecfb23-fa09-4655-8df7-d26b6c0621f5 service nova] Releasing lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:15.477768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.491799 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:15.502822 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.523355 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.579230 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999135353000156 future=<Future at 0x705c6c665a60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:15.581043 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99674634400003 future=<Future at 0x705c6c665a60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:15.581320 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.996337274000098 future=<Future at 0x705c6c665a60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:15.586788 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance destroyed successfully.
May 13 02:09:15.586788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:09:15.586788 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:15.589975 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:15.595307 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:09:15.596030 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.596230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6888479-6e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:15.603851 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:15.605155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.608477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.608477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=295bc161-dfa1-4555-acf3-ae31c56cae17) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:15.608477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.608477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:15.616129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:15.618266 np0000000663 nova-compute[98103]: INFO os_vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e')
May 13 02:09:15.753159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:15.753722 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:15.753962 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No VIF found with MAC fa:16:3e:0e:aa:17, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:15.754673 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Using config drive
May 13 02:09:16.155064 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:16.199639 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Detected multiple connections on this host for volume: c00e1f73-779a-4a20-a2b4-af0cf42f4547, skipping target disconnect.
May 13 02:09:16.205520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.273896 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:16.335503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:16.336472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.472246 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:16.473563 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:16.474319 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.527059 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Creating config drive at /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.config
May 13 02:09:16.532775 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updated VIF entry in instance network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:16.537080 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:16.544910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnnc42qq1 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.611545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk" returned: 0 in 0.138s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:16.611933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk.config /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.630306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnnc42qq1" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:16.675416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk.config /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config" returned: 0 in 0.063s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:16.677076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk.info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:16.736001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "cp -r /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_resize/disk.info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-changed-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing instance network info cache due to event network-changed-533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Acquiring lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Acquired lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:17.045182 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Refreshing network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:17.246471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:17.287390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:17.452401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:17.553276 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:17.603306 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:17.605239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:17.605239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:17.605239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:17.605239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:17.605239 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-211e00fc-8487-493d-a910-e155d447699a req-02d522e5-3dfa-49c5-b35d-d22b77cd48f2 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received unexpected event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with vm_state active and task_state resize_migrating.
May 13 02:09:17.620727 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-194df7ce-cc8c-4b97-93d0-e486c31ceeac req-eb60c5af-5dee-49ef-929c-85e9188a1589 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:17.621022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-194df7ce-cc8c-4b97-93d0-e486c31ceeac req-eb60c5af-5dee-49ef-929c-85e9188a1589 service nova] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:17.621209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-194df7ce-cc8c-4b97-93d0-e486c31ceeac req-eb60c5af-5dee-49ef-929c-85e9188a1589 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:17.621258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-194df7ce-cc8c-4b97-93d0-e486c31ceeac req-eb60c5af-5dee-49ef-929c-85e9188a1589 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:17.621399 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-194df7ce-cc8c-4b97-93d0-e486c31ceeac req-eb60c5af-5dee-49ef-929c-85e9188a1589 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Processing event network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:09:17.816274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:17.824806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:17.864686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:18.003760 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:18.004194 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:18.111462 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Port c6888479-6ed8-4506-a6b4-b4627245a79f binding to destination host np0000000663 is already ACTIVE {{(pid=98103) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 13 02:09:18.116549 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:18.349739 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updated VIF entry in instance network info cache for port 533aa486-0d6c-4235-91bf-8e888684516d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:18.353406 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [{"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:18.587278 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638158.5845942, 4f97648c-78f1-459b-8dcb-c3d6573fb800 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:18.587278 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] VM Started (Lifecycle Event)
May 13 02:09:18.587278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:09:18.595814 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:09:18.600923 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Instance spawned successfully.
May 13 02:09:18.602474 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:09:18.857362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-643898ef-71e3-4c4c-b002-16f3fb3d8fcb req-bb2088c4-8c36-4bac-9205-40b3c7121813 service nova] Releasing lock "refresh_cache-b6762a47-e412-4488-a878-420fb31d8b76" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:19.089578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:19.099313 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:19.116673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.117246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.118660 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.119170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.120373 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.120373 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:09:19.130964 np0000000663 nova-compute[98103]: DEBUG nova.compute.rpcapi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98103) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 13 02:09:19.146511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:19.146511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:19.146511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:19.602153 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:09:19.604105 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638159.6032398, 4f97648c-78f1-459b-8dcb-c3d6573fb800 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:19.604105 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] VM Paused (Lifecycle Event)
May 13 02:09:19.630334 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Took 8.96 seconds to spawn the instance on the hypervisor.
May 13 02:09:19.630518 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:19.773418 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:19.773620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:19.773732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:19.774028 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:19.774028 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] No waiting events found dispatching network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:19.774526 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-935be96f-7f76-4f17-97ee-08e88934fff8 req-af961aa5-b474-4872-9561-670239cd0b00 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received unexpected event network-vif-plugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 for instance with vm_state active and task_state None.
May 13 02:09:20.110718 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:20.113271 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638160.1129575, 4f97648c-78f1-459b-8dcb-c3d6573fb800 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:20.114550 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] VM Resumed (Lifecycle Event)
May 13 02:09:20.151316 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Took 15.26 seconds to build instance.
May 13 02:09:20.165805 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:20.228393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:20.228622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:20.228766 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Shelving
May 13 02:09:20.280975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:20.280975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:20.280975 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:20.480735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:20.608948 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:20.617023 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:20.623129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:20.655039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.776s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:20.783237 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:21.279332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.290573 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.315885 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:21.323123 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.329332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.362339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.578539 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:21.579312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:21.580951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:21.580951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:21.580951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:21.580951 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-cb66dda0-eae0-4afe-99f0-853586924153 req-f73fb7e1-751f-49d7-ae0f-a27d774b86d2 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received unexpected event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with vm_state active and task_state shelving.
May 13 02:09:21.584926 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:21.612701 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.636118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:21.659246 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.9995092690001 future=<Future at 0x705c6c164cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:21.662033 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance destroyed successfully.
May 13 02:09:21.666153 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'numa_topology' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:22.089847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:22.325642 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Beginning cold snapshot process
May 13 02:09:22.580835 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-changed-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:22.581005 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Refreshing instance network info cache due to event network-changed-b6591ce3-f1f9-4189-8cad-807133fd2e27. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:22.581146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] Acquiring lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:22.581262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] Acquired lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:22.581450 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Refreshing network info cache for port b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:22.603303 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:22.621773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:09:22.657890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:22.716323 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:09:22.717976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:09:22.729816 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:09:22.731539 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71', 'fe80::fc16:3eff:fede:c209', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78'] 
May 13 02:09:22.731673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:09:22.731779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:09:22.732126 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:23.083937 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:23.580521 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:23.662809 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:23.664078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:23.664078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:23.664078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:23.664078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:23.664078 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e3946bd0-8af2-4fd5-a4ac-d8cfbc2d112b req-9fd1f1ee-731e-4e8b-88f9-c7237585403d service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received unexpected event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with vm_state active and task_state shelving_image_pending_upload.
May 13 02:09:23.788945 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updated VIF entry in instance network info cache for port b6591ce3-f1f9-4189-8cad-807133fd2e27. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:23.789933 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating instance_info_cache with network_info: [{"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:23.850058 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:09:23.850058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk /opt/stack/data/nova/instances/snapshots/tmpijluaqie/9d96082705ba40feb0a42180c50ea394 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:23.956134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Starting finish_migration {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 13 02:09:23.956134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:09:23.956134 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Creating image(s)
May 13 02:09:23.956848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:24.073177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:24.073177 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:09:24.073177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:24.202312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:24.203122 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Cannot resize image /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:09:24.292704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7033bcae-4ca5-4687-9ac7-36b116b1ec6a req-97af986c-e698-4d27-a55d-776dbd237acd service nova] Releasing lock "refresh_cache-4f97648c-78f1-459b-8dcb-c3d6573fb800" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:24.304365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk /opt/stack/data/nova/instances/snapshots/tmpijluaqie/9d96082705ba40feb0a42180c50ea394" returned: 0 in 0.455s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:24.305944 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Snapshot extracted, beginning image upload
May 13 02:09:24.433078 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:24.708678 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:09:24.709188 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Ensure instance console log exists: /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:09:24.709344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:24.710118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:24.710347 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:24.714479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start _get_guest_xml network_info=[{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '1fb86ac1-3a61-4254-83b6-b79416254ca5', 'attached_at': '2026-05-13T02:09:23.000000', 'detached_at': '', 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'multiattach': True, 'serial': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547'}, 'attachment_id': '9f76a97c-9742-4d2d-a9d4-1cc0ab378318', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:09:24.721405 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:24.723129 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='1fb86ac1-3a61-4254-83b6-b79416254ca5'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638164.7226007) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:09:24.727917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:09:24.729672 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:09:24.736222 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:09:24.736477 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:09:24.736541 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:09:24.736689 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:09:24.736908 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:09:24.737051 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:09:24.737516 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:09:24.737805 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:09:24.738185 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:09:24.754137 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:24.868291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:24.869644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:24.869644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:24.870176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:24.870627 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:09:24.871132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:24.872305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:24.872305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:24.872305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:09:24.889012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:24.889666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:24.890212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:24.890462 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:24.890874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:24.891133 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:24.906525 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:24.906525 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:24.920165 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:24.920165 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:24.923036 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:24.937797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:24.948910 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] instance snapshotting
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.954686 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.955879 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:24.956539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:24.956664 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.962678 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:24.963106 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:24.963979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:24.964211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:24.965450 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('8', '0', '0', 0) found on session 64 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:24.965617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:24.966451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('7', '0', '0', 0) found on session 63 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:24.966631 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:24.984880 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 64 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:24.984880 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:24.985412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 63 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:24.985865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:25.116462 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Beginning live snapshot process
May 13 02:09:25.488571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:25.611209 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:25.890947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:09:26.541731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:26.640393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:26.740840 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:26.745170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:26.838219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json -f qcow2" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:26.839742 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:26.846244 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:26.847664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:26.991356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.143s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:26.991356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee.delta 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:27.057337 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee.delta 1073741824" returned: 0 in 0.066s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:27.059050 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 02:09:27.362641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:09:27.555385 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Snapshot image upload complete
May 13 02:09:27.555890 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:27.866313 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:09:27.870355 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 02:09:27.918623 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:09:27.919042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee.delta /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:28.071025 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Shelve offloading
May 13 02:09:28.200678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee.delta /opt/stack/data/nova/instances/snapshots/tmpf2uuww2p/464d91cb53504eb5ab9355ae379ad9ee" returned: 0 in 0.281s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:28.205782 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Snapshot extracted, beginning image upload
May 13 02:09:28.581614 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance destroyed successfully.
May 13 02:09:28.582291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:28.584382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:28.584563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:28.584701 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:28.595219 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:29.108016 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:29.538389 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:29.744855 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:30.247509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:30.248064 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:30.250250 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:30.492465 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:30.578197 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00047912599984556437 future=<Future at 0x705c6c665a60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:30.578346 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:30.578519 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.079254171000002 future=<Future at 0x705c6c164cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:30.578630 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.07913580100012 future=<Future at 0x705c6c164cb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:30.582244 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638155.5775712, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:30.582244 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Stopped (Lifecycle Event)
May 13 02:09:30.612235 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:30.997245 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance destroyed successfully.
May 13 02:09:30.997245 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'resources' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:31.049293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:31.049413 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing instance network info cache due to event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:31.050426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:31.051246 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:31.051246 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:31.084544 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:31.086934 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:31.468671 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Snapshot image upload complete
May 13 02:09:31.468992 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1db8ab5c-594c-4324-8123-f7bf8d83cfa8 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Took 6.51 seconds to snapshot the instance on the hypervisor.
May 13 02:09:31.498923 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:31.502364 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPee8wUzwjPQReGLhZtrxeUFa0M4Zb++1dNjlQM/Z/y4Coy97qBkjjl0WUIgmQCOofI7a2FVZnr9Ovg/mMy5at1FCudLBbMc1J5eRRYTK+HwpyfZT7s0YFq7zNWFRDFacQ==',key_name='tempest-keypair-1729290138',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:38Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:09:27.555480',shelved_host='np0000000663',shelved_image_id='5e08b8d0-afb3-4e6f-b106-28657f69d17d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:09:31.502364 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:31.502364 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:31.502364 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:09:31.502364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.502628 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80ad54cb-0c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:31.503490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.504238 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:31.505937 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.506709 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.506867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dae1eea7-23ac-4d5e-ac15-376e02f75842) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:31.507356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.507917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:31.509286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:31.513820 np0000000663 nova-compute[98103]: INFO os_vif [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c')
May 13 02:09:31.517245 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Deleting instance files /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc_del
May 13 02:09:31.522352 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Deletion of /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc_del complete
May 13 02:09:31.554183 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:31.589596 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 02:09:31.986598 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:32.100116 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Deleted allocations for instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc
May 13 02:09:32.185010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updated VIF entry in instance network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:32.185216 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:32.449186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:32.605675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:32.606256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:32.689629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-268d07eb-c6eb-462c-aaa8-ac1cf0434ed8 req-e428a46e-639c-4936-b445-b0de4bc09c29 service nova] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:32.937941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 330000000f04cf47c for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:09:32.940946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.067s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:32.940946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (8066ms) {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:32.940946 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f04cf47c', 'path': '/dev/dm-0', 'multipath_id': '330000000f04cf47c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:09:33.006747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:33.006954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:33.337919 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:33.337919 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:33.444552 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:09:33.444773 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:33.445409 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:33.448580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] End _get_guest_xml xml=<domain type="qemu">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <uuid>1fb86ac1-3a61-4254-83b6-b79416254ca5</uuid>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <name>instance-00000021</name>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <memory>262144</memory>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:name>multiattach-server-1</nova:name>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:09:24</nova:creationTime>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.micro" id="84">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:memory>256</nova:memory>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         <nova:port uuid="c6888479-6ed8-4506-a6b4-b4627245a79f">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <system>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="serial">1fb86ac1-3a61-4254-83b6-b79416254ca5</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="uuid">1fb86ac1-3a61-4254-83b6-b79416254ca5</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </system>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <os>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </os>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <features>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </features>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   <devices>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk.config"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <shareable/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:63:47:77"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <target dev="tapc6888479-6e"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </interface>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/console.log" append="off"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </serial>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <video>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </video>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </rng>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:   </devices>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]: </domain>
May 13 02:09:33.448580 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:09:33.448580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000000663',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:09:33.448580 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "vif_mac": "fa:16:3e:63:47:77"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:33.448580 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:33.452901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2b9f560-d10b-54bf-bd5d-d1bd4ed8cf78', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:33.454866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:33.455172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:33.459679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:33.459679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6888479-6e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:33.459679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6888479-6e, col_values=(('qos', UUID('fb754caa-91ee-4ba1-a901-59b4e3ad70d5')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:33.459679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6888479-6e, col_values=(('external_ids', {'iface-id': 'c6888479-6ed8-4506-a6b4-b4627245a79f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:47:77', 'vm-uuid': '1fb86ac1-3a61-4254-83b6-b79416254ca5'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:33.462127 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:33.468122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:33.469548 np0000000663 nova-compute[98103]: INFO os_vif [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e')
May 13 02:09:33.513256 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'flavor' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:33.842119 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:34.351516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.744s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:34.521785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:34.862036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a62400a9-42f9-4e61-b2f7-c425ec7565c6 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.633s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:34.994967 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:34.995083 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:34.995249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:34.995360 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:63:47:77, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:34.995983 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Using config drive
May 13 02:09:35.110462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:35.110562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:35.110747 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Unshelving
May 13 02:09:35.242078 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.495495 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.538973 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.571759 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.577081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.696705 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.698690 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:35.698928 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:35.699119 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attaching volume 6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 to /dev/vdb
May 13 02:09:35.725680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.728265 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:35.749187 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:35.761659 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:09:35.793540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:35.853009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:09:35.853584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:09:35.864801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:09:35.866435 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71', 'fe80::fc16:3eff:fede:c209', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777'] 
May 13 02:09:35.866620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:09:35.866733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:09:35.866973 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:35.867537 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating existing volume attachment record: 4fdaefb1-a4be-4c1b-aee0-4dd428d12ea0 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:09:36.446159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:09:36.446522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:36.446695 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:36.447445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:36.447752 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:09:36.464280 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:36.464786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:36.465065 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:36.466079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:36.466538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:36.466733 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:36.481585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:36.481585 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:36.487430 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:36.487430 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:36.500985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8] added
May 13 02:09:36.500985 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:36.500985 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:36.500985 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:36.500985 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:36.500985 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:36.500985 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:36.501291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:36.501868 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0364(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:36.501868 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:36.503231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8] added
May 13 02:09:36.503231 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:36.503231 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:36.503231 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:36.503231 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:36.503231 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:36.503231 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:36.503403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:36.503670 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:36.503866 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:36.629135 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Booting with volume 9761af2b-8acc-4b43-9573-3b4e37626490 at /dev/vdc
May 13 02:09:36.633497 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638176.6330242, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:36.633749 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Resumed (Lifecycle Event)
May 13 02:09:36.635543 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:09:36.642672 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance running successfully.
May 13 02:09:36.644754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Failed to set time: agent not configured {{(pid=98103) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 13 02:09:36.644945 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090d4807-8dd3-4e43-a4f4-9b02507ba639 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] finish_migration finished successfully. {{(pid=98103) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 13 02:09:36.660690 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.002861053999822616 future=<Future at 0x705c6c164cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:36.661301 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] Emitting event <LifecycleEvent: 1778638161.6576972, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:36.661347 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:36.661900 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Stopped (Lifecycle Event)
May 13 02:09:36.693986 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:36.708426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:09:36.736709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:36.792251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:09:36.793941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:09:36.811486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:09:36.812357 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71', 'fe80::fc16:3eff:fede:c209', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777'] 
May 13 02:09:36.813508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:09:36.813771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:09:36.819471 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:36.819919 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating existing volume attachment record: 52692805-1e8c-4554-9223-6c539528e7eb {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:09:37.142270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:37.148156 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:37.165715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2b9ff729-0fe3-4529-bb1e-88dce1f1cc59 tempest-AttachVolumeNegativeTest-603660763 tempest-AttachVolumeNegativeTest-603660763-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:37.502804 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:37.509753 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:37.520062 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:37.520062 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:37.527427 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:37.527427 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.538009 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.547220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.562225 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.571001 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:37.625195 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.50.100,3260]
May 13 02:09:37.625195 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.50.100,3260] successful.
May 13 02:09:37.625195 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.638756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.40.100,3260]
May 13 02:09:37.638756 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.40.100,3260] successful.
May 13 02:09:37.638756 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.647970 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.654076 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 13 02:09:37.656366 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638177.654922, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:37.656366 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Started (Lifecycle Event)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.674027 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.677330 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:37.677914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:37.681582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:37.681910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:37.683306 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] HCTL ('15', '-', '-', 0) found on session 78 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:37.683434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.726056 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [76] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [77] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56edf43a-27ea-4b81-9d24-333b30cc3d16 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:37.726498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:37.730144 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:37.733201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:37.734701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching for a device in session 78 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:37.735406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:37.736957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] HCTL ('16', '-', '-', 0) found on session 79 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:37.736957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:37.763138 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching for a device in session 79 and hctl ['16', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:38.162007 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:38.166381 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:38.461868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:38.542588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:38.542997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:38.544630 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_requests' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:38.762694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching for a device in session 79 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:38.762995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:38.767502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:38.767770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:38.767970 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Going to confirm migration 4 {{(pid=98103) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 13 02:09:39.051639 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'numa_topology' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:39.272684 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:39.363528 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:39.363793 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:39.363901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:39.364041 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:39.364206 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'info_cache' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:39.485683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Found WWN 330000000a0053ff7 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:09:39.485985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:39.486209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000a0053ff7', 'path': '/dev/dm-4', 'multipath_id': '330000000a0053ff7'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:39.486379 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a0053ff7', 'path': '/dev/dm-4', 'multipath_id': '330000000a0053ff7'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:09:39.489997 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'flavor' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:39.555797 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:09:39.555797 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Claim successful on node np0000000663
May 13 02:09:39.993439 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attempting to attach volume 6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:09:39.995044 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:   <alias name="ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8"/>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:   <serial>6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8</serial>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]: </disk>
May 13 02:09:39.995044 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:09:40.377164 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:40.499200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:40.740318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:40.740615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:40.927106 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:40.946293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:40.948313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:40.948487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:40.948672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:40.948879 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:40.949849 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-fea62c26-5101-4f5f-962e-113525ac4d39 req-0552c229-ab50-41a3-9f32-ea343ee9f32a service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received unexpected event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with vm_state resized and task_state None.
May 13 02:09:41.123195 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:41.252447 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:09:41.519825 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:41.520329 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:41.625582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:41.626046 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'migration_context' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:41.715451 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:41.715606 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:41.715740 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:41.715894 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No VIF found with MAC fa:16:3e:7d:2e:e1, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:41.817037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:42.025664 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:42.129204 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Object Instance<1fb86ac1-3a61-4254-83b6-b79416254ca5> lazy-loaded attributes: info_cache,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:42.134745 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:42.534362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.991s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:42.534860 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:42.536854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.720s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:42.541864 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:09:42.542635 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Claim successful on node np0000000663
May 13 02:09:42.627791 np0000000663 nova-compute[98103]: INFO nova.network.neutron [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating port 80ad54cb-0c0b-4504-ae94-326b9005d7b7 with attributes {'binding:host_id': 'np0000000663', 'device_owner': 'compute:nova'}
May 13 02:09:43.060685 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:43.061298 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:43.061507 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:43.061781 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:43.062049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:43.062239 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e2d872c9-2e88-4e2c-9283-a115658ba830 req-1493d15a-7990-46dd-9115-b5ade8855c4c service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received unexpected event network-vif-plugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with vm_state resized and task_state None.
May 13 02:09:43.237286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:43.237483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:43.237680 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:43.296601 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-045ff362-f3bb-4547-a4e2-cc75128392c7 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.598s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:43.467622 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:43.740368 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:43.802598 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Rescuing
May 13 02:09:43.802780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:43.802901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:43.803008 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:44.101297 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:44.292835 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:44.293203 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:44.308502 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:44.313651 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:44.676489 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:44.795972 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:44.812757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:44.812924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:09:44.813246 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating image(s)
May 13 02:09:44.813751 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:44.813932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:44.815876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:44.816080 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:44.872516 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:45.125265 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:45.125543 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing instance network info cache due to event network-changed-80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:45.125822 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] Acquiring lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:45.125936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] Acquired lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:45.126106 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Refreshing network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:45.302778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.766s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:45.303087 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:09:45.308689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 3.174s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:45.318864 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:45.319524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "1c67cc864dc79f4317a13e038e208f6f102267ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:45.320112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "1c67cc864dc79f4317a13e038e208f6f102267ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:45.375470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:45.502009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:45.631626 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:45.817526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:09:45.819174 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:09:45.819174 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:45.819436 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:45.996527 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abcb4366c82d4e47ac0063497a857553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed9f3615db854b36b4bf3041cc0f1bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:09:46.074853 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:46.222428 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.226029 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.226356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:46.314056 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:46.324084 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:09:46.347611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.part --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:46.348008 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] 5e08b8d0-afb3-4e6f-b106-28657f69d17d was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:09:46.348762 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:09:46.349045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.part /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:46.538846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.part /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.converted" returned: 0 in 0.189s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:46.562333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:46.668199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea.converted --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:46.668683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "1c67cc864dc79f4317a13e038e208f6f102267ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:46.669550 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.674920 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.676395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:46.793822 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Successfully created port: 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:09:46.796353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:46.798104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "1c67cc864dc79f4317a13e038e208f6f102267ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:46.798104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "1c67cc864dc79f4317a13e038e208f6f102267ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:46.800122 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.804668 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:46.805155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:46.846624 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:09:46.881676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:09:46.882201 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:09:46.942011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json" returned: 0 in 0.137s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:46.943305 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea,backing_fmt=raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:47.023199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea,backing_fmt=raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk 1073741824" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:47.023821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "1c67cc864dc79f4317a13e038e208f6f102267ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:47.024114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:47.072472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:47.110008 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:47.114552 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:47.146781 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:47.156471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c67cc864dc79f4317a13e038e208f6f102267ea --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:47.157623 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'migration_context' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:47.275348 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updated VIF entry in instance network info cache for port 80ad54cb-0c0b-4504-ae94-326b9005d7b7. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:47.276047 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:47.376509 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Booting with volume efc2745e-bc3c-477d-a178-41ebcfb4c8f6 at /dev/vda
May 13 02:09:47.389518 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:09:47.428129 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999637686999904 future=<Future at 0x705c6c190ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:47.428981 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998835104999898 future=<Future at 0x705c6c190ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:47.429179 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99851453999986 future=<Future at 0x705c6c190ec0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:09:47.430464 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance destroyed successfully.
May 13 02:09:47.430918 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'numa_topology' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:47.459912 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:47.476148 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:09:47.506122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:47.569482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:09:47.569988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:09:47.584326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:09:47.586087 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fede:c209', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777'] 
May 13 02:09:47.586773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:09:47.587442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:09:47.590551 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:47.590551 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating existing volume attachment record: 7a0d4f3d-64ee-41ff-99d6-23689868de9a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:09:47.672042 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:47.672765 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Rebasing disk image.
May 13 02:09:47.673192 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2fb246c2-86eb-465e-9d21-f06bf84e84fc req-01a6cc08-045e-4784-8887-3e14aed0fb6f service nova] Releasing lock "refresh_cache-0eb5ec8d-4f76-4777-9adc-36852d35ebbc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 -F raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Successfully updated port: 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attempting a stable device rescue
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-0f1e3461-cc78-4b50-adfc-be2b55aa37be req-f29721c3-0831-416a-ad8f-00669f1a78ed service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state active and task_state rescuing.
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98103) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance directory exists: not creating {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Creating image(s)
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'trusted_certs' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.113s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "5b4d71ede3e0af15353232e66114349710dc6262" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:48.925929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "5b4d71ede3e0af15353232e66114349710dc6262" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:48.948501 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:09:48.984759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 -F raw /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk" returned: 0 in 1.179s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:48.985317 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:09:48.985594 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Ensure instance console log exists: /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:09:48.985741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:48.985957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:48.986367 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:48.989021 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start _get_guest_xml network_info=[{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='1909a1170ee3dd21605dc6a86ef27eef',container_format='bare',created_at=2026-05-13T02:09:20Z,direct_url=<?>,disk_format='qcow2',id=5e08b8d0-afb3-4e6f-b106-28657f69d17d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-677316047-shelved',owner='635951473383437bbabc3b1bb776416a',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-13T02:09:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '0eb5ec8d-4f76-4777-9adc-36852d35ebbc', 'attached_at': '', 'detached_at': '', 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'serial': '9761af2b-8acc-4b43-9573-3b4e37626490'}, 'attachment_id': '52692805-1e8c-4554-9223-6c539528e7eb', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:09:48.994123 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:48.995860 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-677316047', uuid='0eb5ec8d-4f76-4777-9adc-36852d35ebbc'), owner=OwnerMeta(userid='2554c8defe944528a06bbfd6f360dcd4', username='tempest-AttachVolumeShelveTestJSON-970754436-project-member', projectid='635951473383437bbabc3b1bb776416a', projectname='tempest-AttachVolumeShelveTestJSON-970754436'), image=ImageMeta(id='5e08b8d0-afb3-4e6f-b106-28657f69d17d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638188.9954169) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:09:49.003725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:09:49.004495 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:09:49.006912 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:09:49.007143 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:09:49.008353 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:09:49.008956 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='1909a1170ee3dd21605dc6a86ef27eef',container_format='bare',created_at=2026-05-13T02:09:20Z,direct_url=<?>,disk_format='qcow2',id=5e08b8d0-afb3-4e6f-b106-28657f69d17d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-677316047-shelved',owner='635951473383437bbabc3b1bb776416a',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-13T02:09:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:09:49.009170 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:09:49.009318 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:09:49.009575 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:09:49.010267 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:09:49.010267 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:09:49.011076 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:09:49.011076 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:09:49.011277 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:09:49.011277 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:09:49.011431 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:09:49.011636 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:49.126727 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocation for migration 908550e4-1b50-42e5-ab79-c6f401f43182
May 13 02:09:49.229787 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:49.477489 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:49.516567 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:49.535700 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:09:49.535700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:49.535700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:49.536245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:49.536629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:09:49.553512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:49.554666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:49.557076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:49.557346 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:49.558598 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:49.559077 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:49.572953 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:49.572953 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:49.580996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:49.580996 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:49.587407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490] added
May 13 02:09:49.587407 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:49.587407 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:49.587407 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:49.587407 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:49.587407 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:49.587407 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:49.589140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:49.589140 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:49.589140 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:49.592330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490] added
May 13 02:09:49.592330 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:49.592330 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:49.592330 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:49.592330 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:49.592330 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:49.592330 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:49.592909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:49.592909 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:49.593159 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:49.644408 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a6964fa-a215-4b47-ba2a-137d544f822d tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 10.877s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:49.729847 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:09:49.732463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:09:49.732887 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating image(s)
May 13 02:09:49.733465 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:09:49.733676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Ensure instance console log exists: /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:09:49.734268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:49.734426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:49.734707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:49.791028 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:49.794667 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:49.798040 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:49.903064 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.part --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:49.906686 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] 78854a74-fa41-4bcb-bf9c-fcd29f06ed10 was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:09:49.906892 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:09:49.906892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.part /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:49.925051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:49.981438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:49.981438 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance network_info: |[{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:09:49.982001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start _get_guest_xml network_info=[{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6ba96da7-7f37-4f58-bb18-cc1196420d0c', 'attached_at': '', 'detached_at': '', 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'serial': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6'}, 'attachment_id': '7a0d4f3d-64ee-41ff-99d6-23689868de9a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:09:49.985998 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:49.987443 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-636646220', uuid='6ba96da7-7f37-4f58-bb18-cc1196420d0c'), owner=OwnerMeta(userid='abcb4366c82d4e47ac0063497a857553', username='tempest-TestShelveInstance-2050500074-project-member', projectid='ed9f3615db854b36b4bf3041cc0f1bb3', projectname='tempest-TestShelveInstance-2050500074'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638189.9870536) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:09:49.990781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:09:49.990781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:09:49.990781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:09:49.990781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:09:49.991526 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:09:49.991915 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:09:49.992156 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:09:49.992237 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:09:49.992680 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:09:49.992680 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:09:49.992680 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:09:49.992840 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:09:49.996129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:09:49.996129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:09:49.996129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:09:49.996129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:09:50.009135 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:09:50.009539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:50.009941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:50.085945 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:50.086647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:50.087077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:50.087343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:50.087517 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:50.087677 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state active and task_state rescuing.
May 13 02:09:50.087938 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:50.087992 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing instance network info cache due to event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:50.088155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:50.088255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:50.088443 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:50.115737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.part /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.converted" returned: 0 in 0.208s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:50.129268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:50.226324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262.converted --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:50.227787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "5b4d71ede3e0af15353232e66114349710dc6262" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.640s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:50.229970 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:50.238838 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:50.244266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "5b4d71ede3e0af15353232e66114349710dc6262" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:50.244767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "5b4d71ede3e0af15353232e66114349710dc6262" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:50.245167 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:50.249893 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:09:50.250326 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:50.376539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262 --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:50.377002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262,backing_fmt=raw /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.rescue {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:50.447018 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b4d71ede3e0af15353232e66114349710dc6262,backing_fmt=raw /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.rescue" returned: 0 in 0.069s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:50.447973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "5b4d71ede3e0af15353232e66114349710dc6262" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:50.448299 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'migration_context' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:50.504245 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:50.589204 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:50.591344 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:50.595306 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:50.605504 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:50.605504 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:50.614472 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:50.614472 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.620503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.627415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.639340 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.639562 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.650773 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.650972 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:50.690473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.40.100,3260]
May 13 02:09:50.690473 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.40.100,3260] successful.
May 13 02:09:50.690473 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.710331 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.718871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.50.100,3260]
May 13 02:09:50.718871 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.50.100,3260] successful.
May 13 02:09:50.718871 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.730982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.737244 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.737665 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:50.737996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:50.737996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:50.739917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] HCTL ('9', '-', '-', 0) found on session 80 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:50.739917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:50.758556 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:50.758556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:50.759757 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] HCTL ('14', '-', '-', 0) found on session 81 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:50.759929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:50.764386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching for a device in session 80 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:50.764386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:50.782497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching for a device in session 81 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:50.782701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:50.884617 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:50.884874 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:50.885033 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:09:50.885275 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:50.885392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances with incomplete migration  {{(pid=98103) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 02:09:50.933385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:50.933591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:50.952547 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:50.962074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:09:50.965843 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start _get_guest_xml network_info=[{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "vif_mac": "fa:16:3e:7d:2e:e1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '78854a74-fa41-4bcb-bf9c-fcd29f06ed10', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'b30e4097-0d76-4cae-a3d4-175cd5c6c5a9', 'attached_at': '', 'detached_at': '', 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'serial': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'}, 'attachment_id': '4fdaefb1-a4be-4c1b-aee0-4dd428d12ea0', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:09:50.966441 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'resources' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:51.039046 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:51.179739 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updated VIF entry in instance network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:51.179986 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:51.388442 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:51.437079 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Detaching volume 75230db6-8513-4f57-aa91-7bdff1fcb9a5
May 13 02:09:51.469393 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:51.479171 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:51.480624 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-592188464', uuid='b30e4097-0d76-4cae-a3d4-175cd5c6c5a9'), owner=OwnerMeta(userid='b3389815009742f7b71399449ef041ce', username='tempest-ServerStableDeviceRescueTest-1052023346-project-member', projectid='89cd0ac04b144296b82948ab2abe19a8', projectname='tempest-ServerStableDeviceRescueTest-1052023346'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "vif_mac": "fa:16:3e:7d:2e:e1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638191.4801996) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:09:51.483036 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:09:51.483621 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:09:51.484915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:09:51.485194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:09:51.486492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:09:51.486890 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:09:51.487064 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:09:51.487181 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:09:51.487317 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:09:51.487414 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:09:51.487508 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:09:51.487651 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:09:51.487749 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:09:51.487867 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:09:51.487985 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:09:51.488126 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:09:51.488281 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'vcpu_model' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:51.495701 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Attempting to driver detach volume 75230db6-8513-4f57-aa91-7bdff1fcb9a5 from mountpoint /dev/vdb
May 13 02:09:51.501590 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Found disk vdb by alias ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:09:51.502932 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Found disk vdb by alias ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:09:51.503157 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Attempting to detach device vdb from instance b6762a47-e412-4488-a878-420fb31d8b76 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:09:51.503513 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <alias name="ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5"/>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <serial>75230db6-8513-4f57-aa91-7bdff1fcb9a5</serial>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]: </disk>
May 13 02:09:51.503513 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:09:51.514047 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully detached device vdb from instance b6762a47-e412-4488-a878-420fb31d8b76 from the persistent domain config.
May 13 02:09:51.514268 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] (1/8): Attempting to detach device vdb with device alias ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5 from instance b6762a47-e412-4488-a878-420fb31d8b76 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:09:51.514609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <alias name="ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5"/>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <serial>75230db6-8513-4f57-aa91-7bdff1fcb9a5</serial>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]: </disk>
May 13 02:09:51.514609 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:09:51.558974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:09:51.682277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6ec01771-c7f8-44ee-8233-e9d4b4a5f0ab req-5337fd37-eda3-4859-b437-5a92e94b5e11 service nova] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:51.890251 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:09:51.991339 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:52.008520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:52.096119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:52.099346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:52.129426 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638192.1289556, b6762a47-e412-4488-a878-420fb31d8b76 => ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:09:52.130371 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-75230db6-8513-4f57-aa91-7bdff1fcb9a5 for instance b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:09:52.134754 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully detached device vdb from instance b6762a47-e412-4488-a878-420fb31d8b76 from the live domain config.
May 13 02:09:52.137941 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:09:52.138320 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:09:52.138485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:52.181261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:52.182472 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing instance network info cache due to event network-changed-a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:52.182762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Acquiring lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:52.182920 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Acquired lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:52.183078 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Refreshing network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:52.580628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Found WWN 3300000008a9e1595 for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:09:52.581183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:52.581435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000008a9e1595', 'path': '/dev/dm-3', 'multipath_id': '3300000008a9e1595'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:52.581602 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008a9e1595', 'path': '/dev/dm-3', 'multipath_id': '3300000008a9e1595'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:09:52.582467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.573s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:52.582855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:09:52.599113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:52.602213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:52.602213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:52.602213 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:52.602213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:52.602213 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:52.615886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:52.615886 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:52.620344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:09:52.620344 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:52.631612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6] added
May 13 02:09:52.631612 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:52.631612 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:52.631612 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:52.631612 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:52.631612 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:52.631612 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:52.631932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:52.632109 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:52.632263 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:52.634521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6] added
May 13 02:09:52.634521 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:09:52.634521 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:52.634521 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:52.634521 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:09:52.634521 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:09:52.634521 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:52.634726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:09:52.634911 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:09:52.635065 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:09:52.688713 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:52.891151 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:52.893810 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:52.895029 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:52.895982 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:52.895982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 02:09:53.091696 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='5e08b8d0-afb3-4e6f-b106-28657f69d17d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1729290138',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:38Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:09:27.555480',shelved_host='np0000000663',shelved_image_id='5e08b8d0-afb3-4e6f-b106-28657f69d17d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:09:53.092158 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:53.093281 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:53.094130 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_devices' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:53.125140 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:53.279110 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updated VIF entry in instance network info cache for port a71035b8-9f4c-437d-b410-614dc6551a90. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:53.279402 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [{"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:53.399305 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] There are 0 instances to clean {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 02:09:53.399883 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:09:53.471669 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.597627 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:53.599031 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] End _get_guest_xml xml=<domain type="qemu">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <uuid>0eb5ec8d-4f76-4777-9adc-36852d35ebbc</uuid>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <name>instance-00000025</name>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-677316047</nova:name>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:09:48</nova:creationTime>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:user uuid="2554c8defe944528a06bbfd6f360dcd4">tempest-AttachVolumeShelveTestJSON-970754436-project-member</nova:user>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:project uuid="635951473383437bbabc3b1bb776416a">tempest-AttachVolumeShelveTestJSON-970754436</nova:project>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         <nova:port uuid="80ad54cb-0c0b-4504-ae94-326b9005d7b7">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <system>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="serial">0eb5ec8d-4f76-4777-9adc-36852d35ebbc</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="uuid">0eb5ec8d-4f76-4777-9adc-36852d35ebbc</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </system>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <os>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </os>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <features>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </features>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   <devices>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <alias name="ua-9761af2b-8acc-4b43-9573-3b4e37626490"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-3"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <target dev="vdc" bus="virtio"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <serial>9761af2b-8acc-4b43-9573-3b4e37626490</serial>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:50:17:9d"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <target dev="tap80ad54cb-0c"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </interface>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/console.log" append="off"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </serial>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <video>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </video>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </rng>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:   </devices>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]: </domain>
May 13 02:09:53.599031 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Preparing to wait for external event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='5e08b8d0-afb3-4e6f-b106-28657f69d17d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1729290138',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:38Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:09:27.555480',shelved_host='np0000000663',shelved_image_id='5e08b8d0-afb3-4e6f-b106-28657f69d17d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:53.602324 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:53.602679 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:09:53.603231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.603231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:53.603594 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:09:53.604885 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.605144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83bc442c-a978-56f5-9e31-a20db46fe495', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:53.606340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.607855 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:53.615362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.619061 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.619351 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80ad54cb-0c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:53.619706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80ad54cb-0c, col_values=(('qos', UUID('77d31552-5a50-4359-969f-9d249427db7e')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:53.619961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80ad54cb-0c, col_values=(('external_ids', {'iface-id': '80ad54cb-0c0b-4504-ae94-326b9005d7b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:17:9d', 'vm-uuid': '0eb5ec8d-4f76-4777-9adc-36852d35ebbc'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:53.621011 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.623045 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:53.633569 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:53.634805 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:53.636581 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:53.637170 np0000000663 nova-compute[98103]: INFO os_vif [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c')
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:53.653052 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:53.653052 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:53.666224 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:53.666224 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.677262 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.683332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.699114 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.705922 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.706398 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:53.751252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260]
May 13 02:09:53.751252 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260] successful.
May 13 02:09:53.751252 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.757230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260]
May 13 02:09:53.757230 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260] successful.
May 13 02:09:53.757230 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.768148 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.773172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:53.781469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Releasing lock "refresh_cache-035777fc-feb7-4c85-97f5-322ea3fb60a7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:53.783118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:53.783118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing instance network info cache due to event network-changed-c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:09:53.783118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Acquiring lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:09:53.783118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Acquired lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:09:53.783118 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Refreshing network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.791756 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.792272 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:53.792272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:53.793309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] HCTL ('17', '-', '-', 0) found on session 82 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:53.793379 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.801799 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:53.802291 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:53.802291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:53.802690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:53.803895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] HCTL ('18', '-', '-', 0) found on session 83 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:53.804076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:53.812338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching for a device in session 82 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:53.812586 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:53.825112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching for a device in session 83 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:53.825112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:54.285455 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:54.602612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:09:54.611292 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:54.644887 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:54.815435 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updated VIF entry in instance network info cache for port c6888479-6ed8-4506-a6b4-b4627245a79f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:09:54.815668 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [{"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:09:55.163940 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:55.164148 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:55.164235 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:55.164304 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No VIF found with MAC fa:16:3e:50:17:9d, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:55.164743 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Using config drive
May 13 02:09:55.318707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a8b329a-41d6-48e6-8c81-4c411cb3d25f req-59a312f3-2c9b-498d-b338-96e3a26512d3 service nova] Releasing lock "refresh_cache-1fb86ac1-3a61-4254-83b6-b79416254ca5" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:09:55.388664 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:55.388925 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:55.389234 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:55.389474 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:09:55.501787 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:55.620875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Found WWN 33000000053051faa for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:09:55.621273 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:55.621492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== connect_volume: return (5611ms) {'type': 'block', 'scsi_wwn': '33000000053051faa', 'path': '/dev/dm-6', 'multipath_id': '33000000053051faa'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:55.621667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053051faa', 'path': '/dev/dm-6', 'multipath_id': '33000000053051faa'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:09:55.622375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.524s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:55.622583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:09:55.634152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:55.634294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:09:55.634660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:55.634891 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:09:55.635203 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:55.637845 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:55.649210 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:55.649210 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:09:55.658962 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:09:55.658962 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:55.667629 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'ec2_ids' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:55.670451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:55.679869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.692986 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.693495 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:55.693903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:55.693903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:55.694852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] HCTL ('15', '0', '0', 0) found on session 78 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:55.695044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.700517 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:55.700985 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:55.701220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:55.701220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:09:55.702140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] HCTL ('16', '0', '0', 0) found on session 79 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:09:55.702219 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:09:55.712773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching for a device in session 78 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:55.713116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:55.714681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Searching for a device in session 79 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:09:55.714851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:09:55.895501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:55.895769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:55.895992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:55.896230 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:09:56.131514 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNHjRx8Ie8JjdF7ibpIk1pSDVp6aIBHI4BtA+dmDB063keYC9/wUS5YBOeJj3qqSu5AO1rTcliDXP7qi+k6voVjl7VkbCp1kCgtVu8f0XDcRNKhun58Mdf+xQ3pYvF5ow==',key_name='tempest-TestShelveInstance-1178221670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:47Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:09:56.131795 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:56.132485 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:56.133108 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:56.171256 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:56.171484 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'keypairs' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:56.636623 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] End _get_guest_xml xml=<domain type="qemu">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <uuid>6ba96da7-7f37-4f58-bb18-cc1196420d0c</uuid>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <name>instance-00000029</name>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestShelveInstance-server-636646220</nova:name>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:09:49</nova:creationTime>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:user uuid="abcb4366c82d4e47ac0063497a857553">tempest-TestShelveInstance-2050500074-project-member</nova:user>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:project uuid="ed9f3615db854b36b4bf3041cc0f1bb3">tempest-TestShelveInstance-2050500074</nova:project>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         <nova:port uuid="23c6fa8b-e040-4780-8aea-8f914748d497">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <system>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="serial">6ba96da7-7f37-4f58-bb18-cc1196420d0c</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="uuid">6ba96da7-7f37-4f58-bb18-cc1196420d0c</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </system>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <os>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </os>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <features>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </features>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   <devices>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <alias name="ua-efc2745e-bc3c-477d-a178-41ebcfb4c8f6"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-6"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <serial>efc2745e-bc3c-477d-a178-41ebcfb4c8f6</serial>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:dd:60:7e"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <target dev="tap23c6fa8b-e0"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </interface>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/console.log" append="off"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </serial>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <video>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </video>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </rng>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:   </devices>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]: </domain>
May 13 02:09:56.636623 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Preparing to wait for external event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNHjRx8Ie8JjdF7ibpIk1pSDVp6aIBHI4BtA+dmDB063keYC9/wUS5YBOeJj3qqSu5AO1rTcliDXP7qi+k6voVjl7VkbCp1kCgtVu8f0XDcRNKhun58Mdf+xQ3pYvF5ow==',key_name='tempest-TestShelveInstance-1178221670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:47Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:56.639544 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:09:56.640023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.640420 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:56.640825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:09:56.641940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.642186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dcbd4cf-4369-52fb-9415-1754bd4317a5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:56.643035 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.644026 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:09:56.644163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:56.653644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.656181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.656398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c6fa8b-e0, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:56.656755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23c6fa8b-e0, col_values=(('qos', UUID('021c3cfc-654f-4e7e-ad46-7ca01cc1a4fa')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:56.656959 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23c6fa8b-e0, col_values=(('external_ids', {'iface-id': '23c6fa8b-e040-4780-8aea-8f914748d497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:60:7e', 'vm-uuid': '6ba96da7-7f37-4f58-bb18-cc1196420d0c'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:09:56.658006 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.659151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:09:56.674905 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<0eb5ec8d-4f76-4777-9adc-36852d35ebbc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:56.677312 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:56.678983 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:56.680306 np0000000663 nova-compute[98103]: INFO os_vif [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0')
May 13 02:09:56.797800 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Creating config drive at /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config
May 13 02:09:56.801753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd5n7y_tn {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:56.857767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd5n7y_tn" returned: 0 in 0.056s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:56.951343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.065926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.066463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.132493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.167058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk.rescue --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.169109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.269046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.270535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.378890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.385132 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.415845 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.458854 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.463524 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.501117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.502894 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.561116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.620487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.622038 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:57.632212 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.666227 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-991f6dfe-f26a-485b-8014-41c0038c44e2 req-f67b44c8-732f-4448-9327-b0b21ba014a2 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:57.666694 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-991f6dfe-f26a-485b-8014-41c0038c44e2 req-f67b44c8-732f-4448-9327-b0b21ba014a2 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:57.667434 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-991f6dfe-f26a-485b-8014-41c0038c44e2 req-f67b44c8-732f-4448-9327-b0b21ba014a2 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:57.668311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-991f6dfe-f26a-485b-8014-41c0038c44e2 req-f67b44c8-732f-4448-9327-b0b21ba014a2 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:57.668563 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-991f6dfe-f26a-485b-8014-41c0038c44e2 req-f67b44c8-732f-4448-9327-b0b21ba014a2 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Processing event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:09:57.673529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Found WWN 330000000a0053ff7 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:09:57.675242 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.052s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:57.675242 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] <== connect_volume: return (5575ms) {'type': 'block', 'scsi_wwn': '330000000a0053ff7', 'path': '/dev/dm-4', 'multipath_id': '330000000a0053ff7'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:57.675242 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a0053ff7', 'path': '/dev/dm-4', 'multipath_id': '330000000a0053ff7'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:09:57.679411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.537s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:09:57.679411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '75230db6-8513-4f57-aa91-7bdff1fcb9a5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:09:57.679411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:57.716981 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [71] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:09:57.717334 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:09:57.717559 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', '71'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', '72'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:09:57.717762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', '72')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:09:57.719627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5', '71')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:09:57.721051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c7920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:09:57.721368 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Removing multipathed devices sdh, sde {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:09:57.721909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Flush multipath device 330000000be0ac26e {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:09:57.747693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.748329 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.764653 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:09:57.794840 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.806444 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.812503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:09:57.844612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.853545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:57.868056 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.873126 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.888204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:09:57.888529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:09:57.890315 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:09:57.903668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:09:57.904264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:09:57.916311 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:57.955163 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.40.100,3260]
May 13 02:09:57.955163 np0000000663 nova-compute[98103]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.40.100,3260] successful.
May 13 02:09:57.955163 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:57.974338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:57.974852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:57.992134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:58.006266 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:58.040583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.50.100,3260]
May 13 02:09:58.040583 np0000000663 nova-compute[98103]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-75230db6-8513-4f57-aa91-7bdff1fcb9a5, portal: 192.168.50.100,3260] successful.
May 13 02:09:58.040583 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:58.059687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:09:58.060167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:09:58.060329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] <== disconnect_volume: return (5921ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:09:58.060529 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:09:58.087147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.091045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.187825 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.188413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.204087 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-592188464',display_name='tempest-ServerStableDeviceRescueTest-server-592188464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverstabledevicerescuetest-server-592188464',id=36,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzDp/iyzFWE16MhS1cHYitjK+qGSRXAJhbgNOwBMlaTtO0N/gf+8RLfV6FWr9beX98956BGPdKq/GVVrrOgxASAg4p1dYvuTVnd3mwysylQdtQ8ikEZPxdZcxL5A4yvfA==',key_name='tempest-keypair-1887025731',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:33Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89cd0ac04b144296b82948ab2abe19a8',ramdisk_id='',reservation_id='r-fsvbfaex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1052023346',owner_user_name='tempest-ServerStableDeviceRescueTest-1052023346-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3389815009742f7b71399449ef041ce',uuid=b30e4097-0d76-4cae-a3d4-175cd5c6c5a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "vif_mac": "fa:16:3e:7d:2e:e1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:09:58.204365 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converting VIF {"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "vif_mac": "fa:16:3e:7d:2e:e1"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:09:58.205441 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:09:58.206624 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'pci_devices' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:58.218032 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:58.218221 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:09:58.218392 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No VIF found with MAC fa:16:3e:dd:60:7e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:09:58.219140 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Using config drive
May 13 02:09:58.291671 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.292045 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:58.294791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.385893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.386437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.403314 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638198.4014971, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:58.404167 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:09:58.405495 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Started (Lifecycle Event)
May 13 02:09:58.410390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:09:58.415449 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance spawned successfully.
May 13 02:09:58.491753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.496275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.542966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:58.544850 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:58.612896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.616112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.630660 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'flavor' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:58.714428 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:09:58.714428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] End _get_guest_xml xml=<domain type="qemu">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <uuid>b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</uuid>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <name>instance-00000024</name>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-592188464</nova:name>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:09:51</nova:creationTime>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:user uuid="b3389815009742f7b71399449ef041ce">tempest-ServerStableDeviceRescueTest-1052023346-project-member</nova:user>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:project uuid="89cd0ac04b144296b82948ab2abe19a8">tempest-ServerStableDeviceRescueTest-1052023346</nova:project>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         <nova:port uuid="2a80ff1d-8a2e-411d-8a2d-ea257e40f944">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <system>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="serial">b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="uuid">b30e4097-0d76-4cae-a3d4-175cd5c6c5a9</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </system>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <os>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </os>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <features>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </features>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   <devices>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <alias name="ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-4"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <serial>6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8</serial>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.rescue"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <target dev="vdc" bus="virtio"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <boot order="1"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </disk>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7d:2e:e1"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <target dev="tap2a80ff1d-8a"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </interface>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/console.log" append="off"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </serial>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <video>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </video>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </rng>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:   </devices>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]: </domain>
May 13 02:09:58.714428 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:09:58.722916 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.722916 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:58.734223 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.735139 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:09:58.765535 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance destroyed successfully.
May 13 02:09:58.850897 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:58.864735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.865260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.911290 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:58.920345 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:09:58.942659 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating config drive at /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config
May 13 02:09:58.946497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppfo72wrb {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:58.965865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:58.973172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:59.002887 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppfo72wrb" returned: 0 in 0.056s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.050015 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:09:59.075660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.076153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:59.165014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.165614 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:59.173871 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:09:59.175697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:59.279221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.283117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:59.364279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c2c3ccf-a9ef-40aa-b755-ebbcb95c7a21 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.253s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:59.388155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.399279 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:09:59.403121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:09:59.428839 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638199.4276133, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:59.429377 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Paused (Lifecycle Event)
May 13 02:09:59.450010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:09:59.451876 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=11195MB free_disk=72.82186126708984GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:09:59.451876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:59.451876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:59.471248 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.515908 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.520230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.554300 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Ignoring supplied device name: /dev/vdb
May 13 02:09:59.591737 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.642021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ca99b9c2-f47a-49b0-9e46-ea8cf3d8de05 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.708s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:59.720062 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:09:59.720427 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:09:59.720651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:09:59.720651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:09:59.720720 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:09:59.720859 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-03c780c0-e668-4b87-8d1e-7b39470af71b req-fd83f2bd-cd4e-468f-b710-090c3d72b19b service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received unexpected event network-vif-plugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with vm_state active and task_state None.
May 13 02:09:59.786686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.794200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.796109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.826797 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:09:59.934686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:09:59.936817 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638199.936609, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:09:59.936964 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Resumed (Lifecycle Event)
May 13 02:10:00.059921 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:00.141656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:00.319702 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:00.319863 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:00.320001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:00.320141 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:00.320281 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] No VIF found with MAC fa:16:3e:7d:2e:e1, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:00.320749 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Using config drive
May 13 02:10:00.439062 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:00.441585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:00.504201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:00.541178 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541298 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541353 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541464 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 86e04c9b-9512-47f6-8849-2c171e65ea18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541540 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 12c32a90-8f0e-4a43-b818-c86882b54d00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541583 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b6762a47-e412-4488-a878-420fb31d8b76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541669 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541748 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541892 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541892 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.541996 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.542062 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 6ba96da7-7f37-4f58-bb18-cc1196420d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:10:00.542278 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:10:00.542417 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2944MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:09:59 up 33 min,  2 users,  load average: 8.63, 7.44, 4.13\n', 'num_instances': '12', 'num_vm_active': '10', 'num_task_None': '10', 'num_os_type_None': '12', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '5', 'io_workload': '2', 'num_proj_2c88a2c430e64df18a80e42983f49a4b': '3', 'num_vm_rescued': '1', 'num_task_rescuing': '1', 'num_proj_89cd0ac04b144296b82948ab2abe19a8': '1', 'num_proj_635951473383437bbabc3b1bb776416a': '1', 'num_proj_8b11777492cc476fb87a83ff007dc8b9': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_ed9f3615db854b36b4bf3041cc0f1bb3': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:10:00.574256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:00.574256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:00.574256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:00.574256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:00.574256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:00.576511 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Terminating instance
May 13 02:10:00.826851 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'ec2_ids' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:00.944386 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638200.9440064, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:00.944573 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Started (Lifecycle Event)
May 13 02:10:01.083042 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:01.112762 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.117809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.146365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.152538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:01.152538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:01.152538 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Attaching volume 88e9c86e-4c8a-4be7-be51-c4870484b4f1 to /dev/vdb
May 13 02:10:01.157710 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:01.157939 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:01.219938 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:01.231895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:10:01.257124 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:01.284751 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.299642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.306049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:10:01.307014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:10:01.322124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:10:01.322124 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::2c3a:59ff:fe08:474e', 'fe80::fc16:3eff:fefd:648a', 'fe80::fc16:3eff:fea0:79ae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fe50:179d', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7'] 
May 13 02:10:01.322124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:10:01.322124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:10:01.322124 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:01.322595 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating existing volume attachment record: 8ce492dd-7660-4dfc-adbe-81dbcc2d8edd {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:10:01.331117 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:10:01.331269 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'keypairs' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:01.447888 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Instance destroyed successfully.
May 13 02:10:01.450914 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid b6762a47-e412-4488-a878-420fb31d8b76 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:01.452894 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:01.456719 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638201.4562817, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:01.456969 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Paused (Lifecycle Event)
May 13 02:10:01.658422 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.663652 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:01.809006 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:01.809554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:01.809794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:01.809975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:01.810271 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:01.810440 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:01.810577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:01.810738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Acquiring lock "b6762a47-e412-4488-a878-420fb31d8b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:01.810919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:01.811072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] Lock "b6762a47-e412-4488-a878-420fb31d8b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:01.811301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] No waiting events found dispatching network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:01.811653 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3ee048d9-0fb8-4a04-af9b-ad974b7a0863 req-d037905e-6614-42e3-8893-a390ebf3e2d1 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-unplugged-533aa486-0d6c-4235-91bf-8e888684516d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:01.837388 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:10:01.841049 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:01.901333 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:10:01.902141 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:01.902141 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:01.902381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:01.902556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:10:01.919199 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:01.920132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:01.920802 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:01.923173 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:01.923839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:01.924036 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:01.929695 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4fb95923-9559-4138-923f-119a88bed6b1 req-5b24795c-96ad-423e-a031-2c4921c361d3 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:01.933414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4fb95923-9559-4138-923f-119a88bed6b1 req-5b24795c-96ad-423e-a031-2c4921c361d3 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:01.933563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4fb95923-9559-4138-923f-119a88bed6b1 req-5b24795c-96ad-423e-a031-2c4921c361d3 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:01.933681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4fb95923-9559-4138-923f-119a88bed6b1 req-5b24795c-96ad-423e-a031-2c4921c361d3 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:01.933865 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4fb95923-9559-4138-923f-119a88bed6b1 req-5b24795c-96ad-423e-a031-2c4921c361d3 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Processing event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:10:01.934547 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:10:01.940937 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:10:01.943401 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:01.943401 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:01.946669 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance spawned successfully.
May 13 02:10:01.946993 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:10:01.953286 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:01.953286 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:01.966813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-227258032',display_name='tempest-ServerRescueNegativeTestJSON-server-227258032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-227258032',id=34,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEBKHNXwFCXl4plP0qcZWYfEK8yfMpHcT9D/zE/pNWrpGxnBWvXitYaZCdQYPOltZRyszM1VcrRh+y6pRi0JKKJ6F1KjcjInD3jSfCBoool3+NRmmkxSJeCbr2zr7j1yQ==',key_name='tempest-keypair-316346649',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:09:03Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-e3kj90ip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=b6762a47-e412-4488-a878-420fb31d8b76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:01.973607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:01.973827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1] added
May 13 02:10:01.973827 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:01.973827 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:01.973827 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:01.973827 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:01.973827 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:01.973827 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:01.974594 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "533aa486-0d6c-4235-91bf-8e888684516d", "address": "fa:16:3e:de:c2:09", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap533aa486-0d", "ovs_interfaceid": "533aa486-0d6c-4235-91bf-8e888684516d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:01.975496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1] added
May 13 02:10:01.975496 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:01.975496 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:01.975496 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:01.975496 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:01.975496 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:01.975496 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:01.976154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:01.977158 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:01.977704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:01.977957 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0553(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:01.978263 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:01.978576 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0539(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:01.978870 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:01.980496 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:01.980496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.981172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap533aa486-0d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:01.983887 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.985637 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:01.985757 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999265464000018 future=<Future at 0x705c486496a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:01.986101 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638201.9857216, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:01.986790 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Resumed (Lifecycle Event)
May 13 02:10:01.990934 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.991855 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.992778 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e3235a7-101f-4fbc-99f8-ee5c1202d922) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:01.995386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:01.995991 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:02.000117 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:02.006270 np0000000663 nova-compute[98103]: INFO os_vif [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c2:09,bridge_name='br-int',has_traffic_filtering=True,id=533aa486-0d6c-4235-91bf-8e888684516d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap533aa486-0d')
May 13 02:10:02.007554 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Deleting instance files /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76_del
May 13 02:10:02.007757 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Deletion of /opt/stack/data/nova/instances/b6762a47-e412-4488-a878-420fb31d8b76_del complete
May 13 02:10:02.037295 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Creating config drive at /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config.rescue
May 13 02:10:02.042083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1m_ack5c {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:02.130856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1m_ack5c" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:02.173950 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:10:02.174559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.723s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:02.175114 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.25 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:02.345588 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:02.428355 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0006245040001431335 future=<Future at 0x705c6c190ec0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:02.428457 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:02.428571 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.556357124999977 future=<Future at 0x705c486496a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:02.428639 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.556281064000132 future=<Future at 0x705c486496a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:02.429563 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Emitting event <LifecycleEvent: 1778638187.4276164, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:02.429821 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Stopped (Lifecycle Event)
May 13 02:10:02.455898 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.456033 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.456375 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.456575 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.456896 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.457161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:02.492847 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:02.497282 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:02.521298 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 02:10:02.524113 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:02.524113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:02.524113 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:02.524113 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:02.635727 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:02.687133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:02.716232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:02.818977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:02.934948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c9a958a0-ee8e-4744-b27b-76eda8f18a68 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:02.965336 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Took 13.24 seconds to spawn the instance on the hypervisor.
May 13 02:10:02.965541 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:02.981486 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:02.981486 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:02.999496 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:02.999496 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.005489 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:03.010143 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:03.010143 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.022744 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.026002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.057729 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.058151 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.059538 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.060039 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:03.083386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:03.088914 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:03.091866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:03.123993 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:03.134169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.50.100,3260]
May 13 02:10:03.134169 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.50.100,3260] successful.
May 13 02:10:03.134169 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.146791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.40.100,3260]
May 13 02:10:03.146791 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.40.100,3260] successful.
May 13 02:10:03.146791 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.156799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.165515 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.184832 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:03.185463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.262s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:03.186164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:03.187357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] HCTL ('13', '-', '-', 0) found on session 85 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:03.187464 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.194203 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [84] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e286020a-6c7c-4e35-8b2d-4650b55b5b9a (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:03.194743 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:03.194743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.274s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:03.195411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:03.196170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] HCTL ('19', '-', '-', 0) found on session 86 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:03.196288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:03.215804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching for a device in session 85 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:03.215979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:03.230452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching for a device in session 86 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:03.230452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:03.398871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-504397d7-3224-4569-ba04-18d54604f874 req-5bcf9b2e-9ca3-4c48-8913-efbca9e3b624 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Received event network-vif-deleted-533aa486-0d6c-4235-91bf-8e888684516d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:03.398871 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-504397d7-3224-4569-ba04-18d54604f874 req-5bcf9b2e-9ca3-4c48-8913-efbca9e3b624 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Neutron deleted interface 533aa486-0d6c-4235-91bf-8e888684516d; detaching it from the instance and deleting it from the info cache
May 13 02:10:03.398871 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-504397d7-3224-4569-ba04-18d54604f874 req-5bcf9b2e-9ca3-4c48-8913-efbca9e3b624 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:03.479424 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Took 21.72 seconds to build instance.
May 13 02:10:03.831406 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:03.859194 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638203.8584507, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:03.859194 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Resumed (Lifecycle Event)
May 13 02:10:03.873747 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-666e4d5b-f8fc-435d-8060-020d776fcc91 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:03.906906 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-504397d7-3224-4569-ba04-18d54604f874 req-5bcf9b2e-9ca3-4c48-8913-efbca9e3b624 service nova] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Detach interface failed, port_id=533aa486-0d6c-4235-91bf-8e888684516d, reason: Instance b6762a47-e412-4488-a878-420fb31d8b76 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:03.921007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:10:03.982253 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.241s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:04.051223 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:04.051264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:04.051472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:04.051584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:04.051773 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:04.051895 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-782a4f32-9673-4c73-b858-c6c60b0dd104 req-6d9769c1-1dc6-45c6-8fc2-1267376bd5c6 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received unexpected event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with vm_state active and task_state None.
May 13 02:10:04.333469 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Took 1.81 seconds to deallocate network for instance.
May 13 02:10:04.375025 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:04.378364 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:04.844469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:04.844469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:04.881869 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638204.881224, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:04.881869 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Started (Lifecycle Event)
May 13 02:10:04.949285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found WWN 3300000001186e8be for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:10:04.949285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:04.949285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '3300000001186e8be', 'path': '/dev/dm-1', 'multipath_id': '3300000001186e8be'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:04.949285 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001186e8be', 'path': '/dev/dm-1', 'multipath_id': '3300000001186e8be'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:10:04.957964 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:05.141961 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Refreshing inventories for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 02:10:05.208657 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Updating ProviderTree inventory for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 02:10:05.208657 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:10:05.257867 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Unrescuing
May 13 02:10:05.258177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:05.258358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:05.258569 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:05.267452 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Refreshing aggregate associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, aggregates: None {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 02:10:05.337632 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Refreshing trait associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, traits: COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ARCH_AARCH64,HW_CPU_X86_MMX,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_MIPSEL,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 02:10:05.384609 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:05.389672 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:05.467078 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Attempting to attach volume 88e9c86e-4c8a-4be7-be51-c4870484b4f1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:10:05.471466 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:   <alias name="ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1"/>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:   <serial>88e9c86e-4c8a-4be7-be51-c4870484b4f1</serial>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:05.471466 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:10:05.507733 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:05.522704 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:05.522958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:05.523288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:05.523366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:05.523534 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:05.523723 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:05.524012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:05.524111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:05.526419 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:05.526973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:05.527421 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:05.527421 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-788652bb-4c25-4541-8777-dff788786288 req-0193344d-6a15-4c1d-b56c-7b1743827c0e service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:05.765158 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:05.897515 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 13 02:10:06.065484 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:06.066998 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing instance network info cache due to event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:06.066998 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:06.313176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:06.313676 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:06.340183 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:06.535852 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:06.819403 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:06.835243 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:06.835243 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing instance network info cache due to event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:06.835847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:06.835992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:06.836395 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:06.995571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.038697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:07.039484 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'flavor' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:07.040972 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:07.041275 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:07.211159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:07.212994 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:07.214500 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:07.214840 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No VIF found with MAC fa:16:3e:0e:aa:17, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:07.325976 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.482s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:07.344559 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:07.431120 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Deleted allocations for instance b6762a47-e412-4488-a878-420fb31d8b76
May 13 02:10:07.545384 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:07.602823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.627309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.641383 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.661229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.667741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:07.848971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:07.850695 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:07.850837 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:07.850964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:07.851170 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:07.851677 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db040032-f3ed-4b28-99c1-791ae04059cb req-43e3883c-0b61-46ca-8b4c-80e47d591a40 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:07.893696 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:07.934740 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99954062599977 future=<Future at 0x705c486487a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:07.939491 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance destroyed successfully.
May 13 02:10:07.941782 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'numa_topology' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:08.090391 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:08.099546 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updated VIF entry in instance network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:08.100305 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:08.134383 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:08.134502 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing instance network info cache due to event network-changed-2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:08.134622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] Acquiring lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:08.287118 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updated VIF entry in instance network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:08.287118 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:08.443243 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c126250-4645-4e00-b0db-3723fefb7662 tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "b6762a47-e412-4488-a878-420fb31d8b76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.869s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:08.445847 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Object Instance<b30e4097-0d76-4cae-a3d4-175cd5c6c5a9> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:10:08.604206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a416201-0689-4a30-bb73-2302ec049977 req-45b250c5-aeaa-4eae-9d26-bbb18b1ba90c service nova] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:08.791407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8925d203-4a12-423c-917b-76da0e27decc req-db1329e1-af73-48a7-9bb5-4e0b706ec6bc service nova] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:08.792018 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] Acquired lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:08.792312 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Refreshing network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:08.798884 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c95bb646-ab6a-4771-894e-1a2e8c1168bb tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.648s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:08.984393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.020062 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.020588 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.152425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.296295 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:09.421697 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.423451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.426763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.451644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.453060 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:09.925038 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:09.925038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:09.925146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:09.925306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:09.925455 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:09.925611 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:09.928403 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:09.928403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:09.928403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:09.929127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:09.929552 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:09.929552 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:09.929732 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:09.931015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:09.931015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:09.931015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:09.931385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:09.931659 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c3bc695b-4504-4e76-a2d5-bd9904816017 req-20bf9d3b-4338-4230-a711-8a10e40a34f1 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received unexpected event network-vif-plugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with vm_state rescued and task_state unrescuing.
May 13 02:10:10.028619 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 due to new event <LifecycleEvent: 1778638210.0282724, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:10:10.028825 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638210.0282724, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:10.028987 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Resumed (Lifecycle Event)
May 13 02:10:10.030716 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-9c8200de-80b2-4a99-8f83-ec5c67981617 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:10.157151 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:10.244760 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:10.386820 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updated VIF entry in instance network info cache for port 2a80ff1d-8a2e-411d-8a2d-ea257e40f944. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:10.387475 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [{"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:10.512458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:10.531882 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:10.537375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:10.892074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-da29cb30-0e6c-45a9-a256-98ded32dc837 req-24e54dee-26d5-4457-8b96-dbc8b50f5031 service nova] Releasing lock "refresh_cache-b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:11.047849 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638211.0475318, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:11.048044 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Started (Lifecycle Event)
May 13 02:10:11.403938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:11.403938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:11.550624 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:11.553972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:11.906408 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Detaching volume c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:10:11.972713 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Attempting to driver detach volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 from mountpoint /dev/vdb
May 13 02:10:11.983446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:11.984891 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:11.985331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Attempting to detach device vdb from instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:10:11.985331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:11.985331 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:11.998376 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 from the persistent domain config.
May 13 02:10:11.999485 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] (1/8): Attempting to detach device vdb with device alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 from instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:10:11.999485 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:11.999485 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:11.999485 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:12.135515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:12.135702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:12.135893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:12.136077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:12.136222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:12.138301 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Terminating instance
May 13 02:10:12.624508 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638212.6241527, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:10:12.633026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 for instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:10:12.636967 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 from the live domain config.
May 13 02:10:12.642735 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:12.664715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:12.669607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:12.699272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:12.858820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:12.860556 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:12.864459 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:12.865892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:12.867641 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:12.870110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:12.870110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:12.870110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc9f9edd-4f97-4a28-a660-2bab084f231c req-55945206-3653-4531-8d63-ee2826c8726a service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:13.038178 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999616917999901 future=<Future at 0x705c6c12e870 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:13.039487 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Instance destroyed successfully.
May 13 02:10:13.039983 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid 12c32a90-8f0e-4a43-b818-c86882b54d00 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:13.215486 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Detected multiple connections on this host for volume: c00e1f73-779a-4a20-a2b4-af0cf42f4547, skipping target disconnect.
May 13 02:10:13.543206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-657084789',display_name='tempest-ServerRescueNegativeTestJSON-server-657084789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-657084789',id=29,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-3jqguyce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:07:20Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=12c32a90-8f0e-4a43-b818-c86882b54d00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:13.543478 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "address": "fa:16:3e:fd:64:8a", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d8e5bb1-23", "ovs_interfaceid": "0d8e5bb1-236d-402f-9f5d-60129fb51d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:13.544460 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:13.544663 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:13.547286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:13.547628 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d8e5bb1-23, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:13.552764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:13.556899 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:13.557261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dbfab494-9dc6-44e8-9b96-5d15bb64609f) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:13.558280 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:13.559282 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:13.559912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:13.562552 np0000000663 nova-compute[98103]: INFO os_vif [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:64:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d8e5bb1-23')
May 13 02:10:13.562992 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Deleting instance files /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00_del
May 13 02:10:13.566657 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Deletion of /opt/stack/data/nova/instances/12c32a90-8f0e-4a43-b818-c86882b54d00_del complete
May 13 02:10:13.780852 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:14.080198 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 02:10:14.080770 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:14.082265 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:14.082470 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:14.083358 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:14.291000 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:14.555160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:14.788211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1a221de4-178f-4415-bafe-e344d6061305 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.384s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:14.814533 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:14.815395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:14.944816 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:14.945024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] Acquiring lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:14.945466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:14.946317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:14.946317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] No waiting events found dispatching network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:14.946317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-unplugged-0d8e5bb1-236d-402f-9f5d-60129fb51d7d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:14.946317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Received event network-vif-deleted-0d8e5bb1-236d-402f-9f5d-60129fb51d7d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:14.946317 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Neutron deleted interface 0d8e5bb1-236d-402f-9f5d-60129fb51d7d; detaching it from the instance and deleting it from the info cache
May 13 02:10:14.946493 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:15.140119 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:15.318697 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Detaching volume c00e1f73-779a-4a20-a2b4-af0cf42f4547
May 13 02:10:15.366942 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Attempting to driver detach volume c00e1f73-779a-4a20-a2b4-af0cf42f4547 from mountpoint /dev/vdb
May 13 02:10:15.373051 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:15.376595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found disk vdb by alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:15.376595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Attempting to detach device vdb from instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:10:15.376595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:15.376595 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:15.392926 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 from the persistent domain config.
May 13 02:10:15.392926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] (1/8): Attempting to detach device vdb with device alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 from instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:10:15.392926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <alias name="ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547"/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <serial>c00e1f73-779a-4a20-a2b4-af0cf42f4547</serial>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:15.392926 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:15.455595 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20e43edd-f155-4f34-80e3-ac62aeafd7bf req-38ba46a0-b0e1-404d-8ec3-2c001270f72b service nova] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Detach interface failed, port_id=0d8e5bb1-236d-402f-9f5d-60129fb51d7d, reason: Instance 12c32a90-8f0e-4a43-b818-c86882b54d00 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:15.527842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:15.640877 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Took 1.56 seconds to deallocate network for instance.
May 13 02:10:16.151724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:16.152872 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:16.851701 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:16.851701 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:16.985948 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.000990812000054575 future=<Future at 0x705c486496a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986083 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986251 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.947937819999879 future=<Future at 0x705c486487a0 state=cancelled>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986371 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.947801636999884 future=<Future at 0x705c486487a0 state=cancelled>) was cancelled while queued, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986449 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986515 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.050921637999636 future=<Future at 0x705c6c12e870 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.986584 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.050857688999713 future=<Future at 0x705c6c12e870 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:16.988681 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Emitting event <LifecycleEvent: 1778638201.9848576, b6762a47-e412-4488-a878-420fb31d8b76 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:16.988928 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] VM Stopped (Lifecycle Event)
May 13 02:10:17.353725 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:17.500978 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: b6762a47-e412-4488-a878-420fb31d8b76] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:17.863669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.711s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:17.924495 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Deleted allocations for instance 12c32a90-8f0e-4a43-b818-c86882b54d00
May 13 02:10:18.558952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:18.790113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638218.78969, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:10:18.791717 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c00e1f73-779a-4a20-a2b4-af0cf42f4547 for instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:10:18.795875 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully detached device vdb from instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 from the live domain config.
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c00e1f73-779a-4a20-a2b4-af0cf42f4547', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:18.835444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-670f087d-f737-44fd-a9be-15282d042aba (non-flash)
May 13 02:10:18.879647 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-670f087d-f737-44fd-a9be-15282d042aba (non-flash)
May 13 02:10:18.881248 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:18.881617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-670f087d-f737-44fd-a9be-15282d042aba', '87')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:18.881617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '64')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:18.883258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547', '63')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:18.884684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c61ce00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'): ({'sdb'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:18.884942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:18.885473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flush multipath device 330000000f04cf47c {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:18.922006 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:18.939413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-120c2aec-eeca-427f-8021-1cf839e012bf tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "12c32a90-8f0e-4a43-b818-c86882b54d00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.803s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:18.969537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:19.016208 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:19.016208 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:19.017773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:19.034931 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:19.035269 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:19.057235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.108495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.40.100,3260]
May 13 02:10:19.108495 np0000000663 nova-compute[98103]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.40.100,3260] successful.
May 13 02:10:19.108495 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.137159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.152311 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.190545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.50.100,3260]
May 13 02:10:19.190545 np0000000663 nova-compute[98103]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-c00e1f73-779a-4a20-a2b4-af0cf42f4547, portal: 192.168.50.100,3260] successful.
May 13 02:10:19.190545 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.212069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:19.212382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:19.212505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== disconnect_volume: return (377ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:19.212626 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:19.629563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:19.633314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:19.633569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:19.633791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:19.633980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:19.635892 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Terminating instance
May 13 02:10:19.776294 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'flavor' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:20.140222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:20.172945 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:20.205425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:20.209928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:20.237444 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:20.382451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:20.382451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:20.393550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:20.393821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:20.393906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:20.393995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:20.394140 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:20.394249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-df697f47-41b2-41e5-9bba-7b316da2cf9f req-f2f52e22-a09f-44fb-9766-5cb2f03a95f8 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:20.507036 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999692117999984 future=<Future at 0x705c487949b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:20.510149 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Instance destroyed successfully.
May 13 02:10:20.510677 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lazy-loading 'resources' on Instance uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:20.529961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:20.788017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-37ae01b6-be01-40cd-84c4-702c156e90e4 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.973s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:20.884619 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:10:21.017027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2097671582',display_name='tempest-ServerRescueNegativeTestJSON-server-2097671582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverrescuenegativetestjson-server-2097671582',id=28,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:07:34Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c88a2c430e64df18a80e42983f49a4b',ramdisk_id='',reservation_id='r-t4m1vc32',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1325017662',owner_user_name='tempest-ServerRescueNegativeTestJSON-1325017662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:07:42Z,user_data=None,user_id='c1cf7b3eb74a47aca33e0d7fc78c7b0e',uuid=86e04c9b-9512-47f6-8849-2c171e65ea18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:21.017027 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converting VIF {"id": "a5f207e1-53af-4e40-934d-423a19436021", "address": "fa:16:3e:a0:79:ae", "network": {"id": "48f47c1b-78fc-40d5-9cd0-17b817a912f2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1597422325-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c88a2c430e64df18a80e42983f49a4b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f207e1-53", "ovs_interfaceid": "a5f207e1-53af-4e40-934d-423a19436021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:21.017027 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:21.017546 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:21.018166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:21.021806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f207e1-53, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:21.026949 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:21.028183 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:21.028974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:21.033696 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:21.033976 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=511e75a6-6e1b-444a-b8da-8c15da7fd5ba) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:21.035638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:21.036676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:21.041487 np0000000663 nova-compute[98103]: INFO os_vif [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:79:ae,bridge_name='br-int',has_traffic_filtering=True,id=a5f207e1-53af-4e40-934d-423a19436021,network=Network(48f47c1b-78fc-40d5-9cd0-17b817a912f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f207e1-53')
May 13 02:10:21.042058 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Deleting instance files /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18_del
May 13 02:10:21.042612 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Deletion of /opt/stack/data/nova/instances/86e04c9b-9512-47f6-8849-2c171e65ea18_del complete
May 13 02:10:21.451429 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:21.451664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:21.456593 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:10:21.457119 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Claim successful on node np0000000663
May 13 02:10:21.554325 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Took 1.41 seconds to destroy the instance on the hypervisor.
May 13 02:10:21.555127 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:21.555425 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:21.555490 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:21.555700 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:21.642189 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:22.444546 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:22.503641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:22.503864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:22.504057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:22.504256 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:22.504399 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] No waiting events found dispatching network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:22.504616 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-unplugged-a5f207e1-53af-4e40-934d-423a19436021 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:22.504689 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-376ff592-5121-49a4-a1fd-0e1ba0c6630d req-c98a9281-9a7e-4644-bb1f-c41d6d7ee481 service nova] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Received event network-vif-deleted-a5f207e1-53af-4e40-934d-423a19436021 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:22.948511 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Took 1.39 seconds to deallocate network for instance.
May 13 02:10:23.194019 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:23.194328 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:23.456625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:23.697313 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:24.103996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:24.104220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:24.207512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.756s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:24.207941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:10:24.211779 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.752s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:24.430630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:24.430822 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:24.607379 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:10:24.720537 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:10:24.721249 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:10:24.722542 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:24.729002 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:24.826951 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a446089b72fe48f08627c913ee7d5f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7626320b52f49c0888006226eb492ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:10:24.934688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:10:25.001995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:25.002321 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:25.197680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:25.220702 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:10:25.375804 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Successfully created port: eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:10:25.501298 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:25.505535 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:25.532436 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:25.726157 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:10:25.943664 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Successfully updated port: eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:10:26.010750 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-changed-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:26.011106 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing instance network info cache due to event network-changed-eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:26.011300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:26.011424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:26.011564 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing network info cache for port eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:26.014005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.806s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:26.016398 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.819s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.019493 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:10:26.020052 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Claim successful on node np0000000663
May 13 02:10:26.035988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:26.101119 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Deleted allocations for instance 86e04c9b-9512-47f6-8849-2c171e65ea18
May 13 02:10:26.231035 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Booting with volume fd773d95-c697-47ff-971d-6e661f15b439 at /dev/vda
May 13 02:10:26.270134 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:26.280777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:10:26.298610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:26.339695 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:10:26.340008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:10:26.350129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:10:26.352439 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fe50:179d', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71'] 
May 13 02:10:26.352439 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:10:26.352439 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:10:26.352439 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:26.352439 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating existing volume attachment record: 4bbe6c58-d54e-478a-ad02-8434e06cb25a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:10:26.421551 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_power_states {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:26.448077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:26.517350 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:26.587050 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:26.761444 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:26.931963 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] While synchronizing instance power states, found 12 instances in the database and 9 instances on the hypervisor.
May 13 02:10:26.932104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid cbbe0827-c00e-48cf-92c5-9246a81c635c {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.932988 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.933557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:26.933804 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.934590 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.935144 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:26.935284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.936613 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.937243 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:26.939016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.942701 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.945309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:26.945903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.950968 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.951232 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.951414 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.954222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.954467 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.961925 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:26.963633 np0000000663 nova-compute[98103]: WARNING nova.utils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x705c88308d60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 13 02:10:26.964802 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:26.964802 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 86e04c9b-9512-47f6-8849-2c171e65ea18 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.967359 np0000000663 nova-compute[98103]: WARNING nova.utils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x705c88308d60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 13 02:10:26.967635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:10:26.967786 np0000000663 nova-compute[98103]: WARNING nova.utils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x705c88308d60> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 13 02:10:26.968771 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.91 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:27.109322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-241b8275-1000-4f84-8639-47c780b31fbe tempest-ServerRescueNegativeTestJSON-1325017662 tempest-ServerRescueNegativeTestJSON-1325017662-project-member] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.479s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.263606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5cf3d89-33ef-4f77-8448-48895cb968d4 req-4b089680-9772-4707-abf3-3726d5fab105 service nova] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:27.264153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:27.264229 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:27.446896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.447060 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.447214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:27.451155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.516s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.451373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.453732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:27.464457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.518s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.464644 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.464776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:27.469517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.531s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.469709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.476361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.514s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.476839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.579380 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:27.579574 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:27.834524 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:27.952360 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.952626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "86e04c9b-9512-47f6-8849-2c171e65ea18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.952897 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:27.956541 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.956863 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:27.957055 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:27.968677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:27.984614 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:28.037979 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.000366352000128245 future=<Future at 0x705c6c12e870 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:28.037979 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:28.038170 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.468664941000043 future=<Future at 0x705c487949b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:28.038170 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.46859733600013 future=<Future at 0x705c487949b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:28.038418 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638213.037381, 12c32a90-8f0e-4a43-b818-c86882b54d00 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:28.038557 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] VM Stopped (Lifecycle Event)
May 13 02:10:28.082568 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:28.146887 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:28.458540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "86e04c9b-9512-47f6-8849-2c171e65ea18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:28.464283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:28.478760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:10:28.479873 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:10:28.479982 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Creating image(s)
May 13 02:10:28.480216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:10:28.480633 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Ensure instance console log exists: /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:10:28.480633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:28.480831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:28.480831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:28.541769 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 12c32a90-8f0e-4a43-b818-c86882b54d00] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:28.593887 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.578s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:28.595142 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.094s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:28.595142 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:10:28.605034 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:10:28.608437 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Claim successful on node np0000000663
May 13 02:10:28.652119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:28.652119 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance network_info: |[{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:10:28.652119 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Start _get_guest_xml network_info=[{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '35a03c2e-e053-46e6-bb2e-5668f555c78e', 'attached_at': '', 'detached_at': '', 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'serial': 'fd773d95-c697-47ff-971d-6e661f15b439'}, 'attachment_id': '4bbe6c58-d54e-478a-ad02-8434e06cb25a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:10:28.652652 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:10:28.653635 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-2027963012', uuid='35a03c2e-e053-46e6-bb2e-5668f555c78e'), owner=OwnerMeta(userid='a446089b72fe48f08627c913ee7d5f9e', username='tempest-TestInstancesWithCinderVolumes-1077980962-project-member', projectid='c7626320b52f49c0888006226eb492ce', projectname='tempest-TestInstancesWithCinderVolumes-1077980962'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638228.6533344) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:10:28.654780 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:10:28.655116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:10:28.656007 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:10:28.656165 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:10:28.657038 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:10:28.657292 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:10:28.657416 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:10:28.657512 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:10:28.657666 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:10:28.659477 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:10:28.659655 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:10:28.659777 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:10:28.659886 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:10:28.660043 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:10:28.660210 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:10:28.660329 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:10:28.679539 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:10:28.683326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:28.683579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:28.683772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:28.683969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:10:28.698589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:28.699074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:28.699597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:28.699851 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:28.700210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:28.700458 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:28.711786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:28.711786 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:28.720833 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:28.720833 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:28.729980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439] added
May 13 02:10:28.729980 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:28.729980 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:28.729980 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:28.729980 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:28.729980 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:28.729980 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:28.730352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:28.730352 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:28.730504 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:28.734044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439] added
May 13 02:10:28.734044 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:28.734044 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:28.734044 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:28.734044 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:28.734044 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:28.734044 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:28.734398 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:28.734398 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:28.734498 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:29.034398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:29.100010 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:10:29.100226 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:10:29.100492 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:29.100773 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:29.167962 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1cbbca488aa421e8bb3c5cbacb6c4c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c4c5b67d6749e98f7ab1203bb6201b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:10:29.602464 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:10:29.650511 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Successfully created port: 48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:10:29.730887 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:29.734998 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:29.744408 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:29.744408 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:29.750928 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:29.750928 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.759037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.766751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.777369 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.777714 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.783003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.783223 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:29.824017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.50.100,3260]
May 13 02:10:29.824017 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.50.100,3260] successful.
May 13 02:10:29.824017 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.832643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.40.100,3260]
May 13 02:10:29.832643 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.40.100,3260] successful.
May 13 02:10:29.832643 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.837434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.848058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.863497 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.863908 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:29.864137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:29.864137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.865283 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:29.865568 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:29.865970 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:29.866217 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:29.868617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('7', '-', '-', 0) found on session 90 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:29.868747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:29.870203 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('8', '-', '-', 0) found on session 91 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:29.870891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:29.886590 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 90 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:29.886754 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:29.894373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 91 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:29.894373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:29.948339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:29.948539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:30.105407 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:10:30.212456 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Successfully updated port: 48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:10:30.229579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:30.229909 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:30.273032 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-changed-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:30.273280 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Refreshing instance network info cache due to event network-changed-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:30.273352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] Acquiring lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:30.273434 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] Acquired lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:30.273743 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Refreshing network info cache for port 48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:30.453172 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Detaching volume 88e9c86e-4c8a-4be7-be51-c4870484b4f1
May 13 02:10:30.504584 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Attempting to driver detach volume 88e9c86e-4c8a-4be7-be51-c4870484b4f1 from mountpoint /dev/vdb
May 13 02:10:30.523195 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found disk vdb by alias ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:30.524985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found disk vdb by alias ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:30.525231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Attempting to detach device vdb from instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:10:30.525472 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <alias name="ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1"/>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <serial>88e9c86e-4c8a-4be7-be51-c4870484b4f1</serial>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:30.525472 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:30.532848 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully detached device vdb from instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 from the persistent domain config.
May 13 02:10:30.533030 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] (1/8): Attempting to detach device vdb with device alias ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1 from instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:10:30.533372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <alias name="ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1"/>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <serial>88e9c86e-4c8a-4be7-be51-c4870484b4f1</serial>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:30.533372 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:30.534741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:30.612276 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Booting with volume ffe3c430-ac9f-47a3-8afb-04e332b0050f at /dev/vda
May 13 02:10:30.677653 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:30.689852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:10:30.700420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:10:30.710879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:30.724452 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:30.738476 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:30.760019 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:10:30.761020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:10:30.773180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:10:30.773180 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe0e:aa17', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fe50:179d', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7', 'fe80::fc16:3eff:fe7d:2ee1', 'fe80::a408:2cff:fe4a:4b71'] 
May 13 02:10:30.773786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:10:30.774299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:10:30.775283 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:30.776045 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Updating existing volume attachment record: bf67822d-1d30-4773-919b-d5e911a5dfe0 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:10:30.779672 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:30.892959 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:31.039195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:31.042268 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:31.046151 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1 for instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:10:31.046151 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638231.045543, 4f97648c-78f1-459b-8dcb-c3d6573fb800 => ua-88e9c86e-4c8a-4be7-be51-c4870484b4f1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:10:31.048790 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully detached device vdb from instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 from the live domain config.
May 13 02:10:31.049960 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:31.050389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:31.050560 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:31.253934 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.660s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:31.254411 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:10:31.548637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bd088488-375c-4353-b56b-56b87bc3cd04 req-49514824-f5d4-46bf-8dfc-567ea270e6c9 service nova] Releasing lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:31.548637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquired lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:31.548637 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:31.717904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found WWN 330000000568b5463 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:10:31.717904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:31.717904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000568b5463', 'path': '/dev/dm-0', 'multipath_id': '330000000568b5463'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:31.718174 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000568b5463', 'path': '/dev/dm-0', 'multipath_id': '330000000568b5463'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:10:31.718543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.668s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:31.719285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '88e9c86e-4c8a-4be7-be51-c4870484b4f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:31.719481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:31.753966 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [85] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:31.754438 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '86'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:31.754438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '86')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:31.755637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1', '85')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:31.763155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:10:31.763155 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:10:31.763335 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:31.763641 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:31.767794 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c6ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'): ({'sdh'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:31.768179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Removing multipathed devices sdn, sdh {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:31.768419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flush multipath device 3300000001186e8be {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:31.805275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:31.853986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:31.884963 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99b42dec2d7345d7a446924b3f75142e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ca7073b3146308156a52a09a12713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:10:31.906794 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking to see if SCSI volumes sdn, sdh have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:31.907034 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] SCSI volumes sdn, sdh have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:31.909519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking to see if device paths {'sdn', 'sdh'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:31.920468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Device paths {'sdn', 'sdh'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:31.920674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:31.933839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:31.975427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.40.100,3260]
May 13 02:10:31.975427 np0000000663 nova-compute[98103]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.40.100,3260] successful.
May 13 02:10:31.975427 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:32.003193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:32.015182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:32.047187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.50.100,3260]
May 13 02:10:32.047187 np0000000663 nova-compute[98103]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-88e9c86e-4c8a-4be7-be51-c4870484b4f1, portal: 192.168.50.100,3260] successful.
May 13 02:10:32.047187 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:32.066442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:32.066680 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:32.066850 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== disconnect_volume: return (1016ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:32.067008 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:32.147541 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:32.225023 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2027963012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testinstanceswithcindervolumes-server-2027963012',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGzeNpTxUS2g70jLtSgROdpKtQXCo3O1crOCJQo6SwUJt+qdTE8YP6fhLWnIbmAafXHUcq0KEgq6HnGwbP+1/O9Qky1YPyuh9ltMaey5gtHUH3Q7pEegDrAHCE9s4rwfg==',key_name='tempest-TestInstancesWithCinderVolumes-902738017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7626320b52f49c0888006226eb492ce',ramdisk_id='',reservation_id='r-2zrjusqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1077980962',owner_user_name='tempest-TestInstancesWithCinderVolumes-1077980962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:26Z,user_data=None,user_id='a446089b72fe48f08627c913ee7d5f9e',uuid=35a03c2e-e053-46e6-bb2e-5668f555c78e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:10:32.225287 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converting VIF {"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:32.225929 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:32.226548 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'pci_devices' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:32.272584 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:10:32.345868 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:32.457801 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Successfully created port: cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:10:32.547991 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Updating instance_info_cache with network_info: [{"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:32.617071 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:32.729675 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] End _get_guest_xml xml=<domain type="qemu">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <uuid>35a03c2e-e053-46e6-bb2e-5668f555c78e</uuid>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <name>instance-0000002a</name>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-2027963012</nova:name>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:10:28</nova:creationTime>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:user uuid="a446089b72fe48f08627c913ee7d5f9e">tempest-TestInstancesWithCinderVolumes-1077980962-project-member</nova:user>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:project uuid="c7626320b52f49c0888006226eb492ce">tempest-TestInstancesWithCinderVolumes-1077980962</nova:project>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         <nova:port uuid="eb257c5e-1da0-42d8-8071-669804e98690">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <system>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="serial">35a03c2e-e053-46e6-bb2e-5668f555c78e</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="uuid">35a03c2e-e053-46e6-bb2e-5668f555c78e</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </system>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <os>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </os>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <features>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </features>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   <devices>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/disk.config"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <alias name="ua-fd773d95-c697-47ff-971d-6e661f15b439"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <serial>fd773d95-c697-47ff-971d-6e661f15b439</serial>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:8d:d0:e5"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <target dev="tapeb257c5e-1d"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </interface>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/console.log" append="off"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </serial>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <video>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </video>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </rng>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:   </devices>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]: </domain>
May 13 02:10:32.729675 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:10:32.731866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Preparing to wait for external event network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:10:32.731866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:32.731866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:32.731866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:32.731866 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2027963012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testinstanceswithcindervolumes-server-2027963012',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGzeNpTxUS2g70jLtSgROdpKtQXCo3O1crOCJQo6SwUJt+qdTE8YP6fhLWnIbmAafXHUcq0KEgq6HnGwbP+1/O9Qky1YPyuh9ltMaey5gtHUH3Q7pEegDrAHCE9s4rwfg==',key_name='tempest-TestInstancesWithCinderVolumes-902738017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7626320b52f49c0888006226eb492ce',ramdisk_id='',reservation_id='r-2zrjusqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1077980962',owner_user_name='tempest-TestInstancesWithCinderVolumes-1077980962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:26Z,user_data=None,user_id='a446089b72fe48f08627c913ee7d5f9e',uuid=35a03c2e-e053-46e6-bb2e-5668f555c78e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:10:32.732070 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converting VIF {"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:32.732666 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:32.733007 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:10:32.733299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.733516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:32.733767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:10:32.736206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.736206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55e9a97e-9f9e-531e-82fe-87418aeaf621', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:32.741339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.742019 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:32.743748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.747290 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.747472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb257c5e-1d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:32.747860 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb257c5e-1d, col_values=(('qos', UUID('3ae655e5-5468-45b1-949b-39deac9a2ae3')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:32.748074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb257c5e-1d, col_values=(('external_ids', {'iface-id': 'eb257c5e-1da0-42d8-8071-669804e98690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:d0:e5', 'vm-uuid': '35a03c2e-e053-46e6-bb2e-5668f555c78e'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:32.749059 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.751936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:32.755848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:32.756864 np0000000663 nova-compute[98103]: INFO os_vif [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d')
May 13 02:10:32.778021 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:10:32.898104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:10:32.899580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:10:32.899915 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Creating image(s)
May 13 02:10:32.900403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:10:32.900567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Ensure instance console log exists: /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:10:32.901063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:32.901306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:32.901473 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:32.998269 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Successfully updated port: cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:10:33.049017 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-changed-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:33.049017 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Refreshing instance network info cache due to event network-changed-cb581ae8-654d-4b1e-bb9e-d908d2effedf. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:33.049017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] Acquiring lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:33.049017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] Acquired lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:33.049017 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Refreshing network info cache for port cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:33.051893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Releasing lock "refresh_cache-30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:33.052391 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance network_info: |[{"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:10:33.054434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Start _get_guest_xml network_info=[{"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '30b0dfcd-6246-4843-a7c0-f7b3c60f8c56', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'serial': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'multiattach': True}, 'attachment_id': 'bf67822d-1d30-4773-919b-d5e911a5dfe0', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:10:33.059483 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:10:33.061820 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1804132156', uuid='30b0dfcd-6246-4843-a7c0-f7b3c60f8c56'), owner=OwnerMeta(userid='a1cbbca488aa421e8bb3c5cbacb6c4c8', username='tempest-AttachVolumeMultiAttachTest-2055478852-project-member', projectid='99c4c5b67d6749e98f7ab1203bb6201b', projectname='tempest-AttachVolumeMultiAttachTest-2055478852'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638233.059368) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:10:33.068822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:10:33.068970 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:10:33.070278 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:10:33.070278 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:10:33.070988 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:10:33.071271 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:10:33.071448 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:10:33.072104 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:10:33.072104 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:10:33.072104 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:10:33.072104 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:10:33.072294 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:10:33.072329 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:10:33.072471 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:10:33.072589 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:10:33.075030 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:10:33.106131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:10:33.106479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:33.106654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:33.107182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:33.107431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:10:33.125030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:33.129579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:33.131129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:33.131680 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:33.131950 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:33.132671 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:33.146913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:33.146913 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:33.149526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:10:33.149526 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:33.154731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f] added
May 13 02:10:33.163660 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:33.163660 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:33.163660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:33.164650 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f] added
May 13 02:10:33.164650 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:10:33.164650 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:33.164650 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:33.164650 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:10:33.164650 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:10:33.164650 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:33.164886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:10:33.165136 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:33.165350 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:33.165871 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:10:33.165871 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:10:33.500676 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:33.551424 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:33.631273 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c259f020-dcab-447c-9e7d-bec769b51590 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.683s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:33.690906 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:33.787678 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:10:33.788878 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:10:33.789502 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Creating image(s)
May 13 02:10:33.790527 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:33.790773 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:33.791314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:33.792191 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:33.795613 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:33.797591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:33.927881 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:33.930061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:33.930706 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:33.934397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:33.934900 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:33.942306 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:33.942782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:34.045861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:34.046382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:34.117656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk 1073741824" returned: 0 in 0.071s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:34.118308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:34.118791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:34.167330 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:10:34.169445 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:34.183642 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:34.183642 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:10:34.194574 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:10:34.194574 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.202958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.211346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.227003 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.234769 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:34.235531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:34.238377 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:10:34.238641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:34.258061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:34.258061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:34.258061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:34.258061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:34.258061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:34.262998 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Terminating instance
May 13 02:10:34.288254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:34.288254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:34.288254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No VIF found with MAC fa:16:3e:8d:d0:e5, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:34.289594 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Using config drive
May 13 02:10:34.291904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.50.100,3260]
May 13 02:10:34.291904 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.50.100,3260] successful.
May 13 02:10:34.291904 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.302422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.40.100,3260]
May 13 02:10:34.302422 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.40.100,3260] successful.
May 13 02:10:34.302422 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.311223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.321240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.335834 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.336240 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:34.336480 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:34.336649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:34.338075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:34.338225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.347488 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:34.347874 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:34.348245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:34.348477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:34.348951 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Cannot resize image /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:10:34.349341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:10:34.349528 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:10:34.349725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Ensure instance console log exists: /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:10:34.350080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:34.350413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:34.350472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:34.351616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] HCTL ('13', '-', '-', 0) found on session 93 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:10:34.351730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:10:34.361347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:34.361569 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:34.370935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Searching for a device in session 93 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:10:34.371143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:10:34.433658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-83baf9bd-2790-42c0-b6f4-242e594d5c27 req-cd17c3c0-613f-4e15-ac13-19b8b1225b25 service nova] Releasing lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:34.437369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquired lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:34.437674 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:34.767361 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:34.792672 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:34.807264 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:34.819326 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:34.834873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:34.865003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:34.996826 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Creating config drive at /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/disk.config
May 13 02:10:35.001888 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:35.002107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:35.004007 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:35.004182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:35.004335 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] No waiting events found dispatching network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:35.004457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0ee6154d-605f-40cf-a7e7-9b41c96a2cf8 req-91ebed04-6de7-45ec-953a-fb6fd9eee7a5 service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:35.006879 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:35.014502 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_y5kq0vu {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:35.073591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_y5kq0vu" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:35.141417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:10:35.238335 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:35.310785 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.996875384000305 future=<Future at 0x705c487349b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:35.317833 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Instance destroyed successfully.
May 13 02:10:35.319532 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'resources' on Instance uuid 4f97648c-78f1-459b-8dcb-c3d6573fb800 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:35.430863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.462972 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating instance_info_cache with network_info: [{"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:35.507335 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005811940000057803 future=<Future at 0x705c487949b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:35.508389 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:35.508562 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.797459191000144 future=<Future at 0x705c487349b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:35.508708 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.797319641000286 future=<Future at 0x705c487349b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:35.509187 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Emitting event <LifecycleEvent: 1778638220.5066223, 86e04c9b-9512-47f6-8849-2c171e65ea18 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:35.509401 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] VM Stopped (Lifecycle Event)
May 13 02:10:35.536936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.592783 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.625841 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.626961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.724975 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.822600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:09:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2081565242',display_name='tempest-VolumesBackupsTest-instance-2081565242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-2081565242',id=40,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOxesDf5shc/dm64nP+QaPLk5NTmRPbHScnTuOUwt/2bpy0N6IaTEVgWkmCpFAmkFvoWoIdaAh+5ucsm+7SYKuqUs5g6xTVy0IGMNNBsvZXY/0WSdv2fVTBYJNwQOZ0Ug==',key_name='tempest-keypair-2033583975',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:09:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-fc782h5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=4f97648c-78f1-459b-8dcb-c3d6573fb800,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:35.822600 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "address": "fa:16:3e:0e:aa:17", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6591ce3-f1", "ovs_interfaceid": "b6591ce3-f1f9-4189-8cad-807133fd2e27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:35.824162 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:35.824162 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:35.831150 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.831464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6591ce3-f1, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:35.833209 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.834190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:35.835056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.836447 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.837843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46b655fa-4a2d-482a-9bc2-1e480f345653) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:35.837843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.838359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:35.839498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.842511 np0000000663 nova-compute[98103]: INFO os_vif [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:aa:17,bridge_name='br-int',has_traffic_filtering=True,id=b6591ce3-f1f9-4189-8cad-807133fd2e27,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6591ce3-f1')
May 13 02:10:35.844395 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Deleting instance files /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800_del
May 13 02:10:35.846901 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Deletion of /opt/stack/data/nova/instances/4f97648c-78f1-459b-8dcb-c3d6573fb800_del complete
May 13 02:10:35.935227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.940599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.965464 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:35.966761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Releasing lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:35.967833 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance network_info: |[{"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:10:35.970352 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Start _get_guest_xml network_info=[{"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:10:35.980322 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:10:35.980322 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-1721294325', uuid='7a8c1c60-c451-4350-8460-dd46e717314a'), owner=OwnerMeta(userid='99b42dec2d7345d7a446924b3f75142e', username='tempest-VolumesSnapshotTestJSON-2040320791-project-member', projectid='179ca7073b3146308156a52a09a12713', projectname='tempest-VolumesSnapshotTestJSON-2040320791'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638235.9792159) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:10:35.982560 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:10:35.983340 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:10:35.986651 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:10:35.986868 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:10:35.988192 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:10:35.988192 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:10:35.988360 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:10:35.988360 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:10:35.988461 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:10:35.988553 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:10:35.988643 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:10:35.988796 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:10:35.988891 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:10:35.989011 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:10:35.989122 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:10:35.989247 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:10:35.999529 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1721294325',display_name='tempest-VolumesSnapshotTestJSON-instance-1721294325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-1721294325',id=44,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqIiL9UyJ2RBSVaL84a/Sd8T1Ua2++QdyarU1MCyHUrM8+3s/kIBLxI3CUDH81eNgWyjC0opLMsEBHnoUMzXjBfowrJsT1tk8R3mXbaTbH40Qta7YL8qpmK/kwxXoSs1Q==',key_name='tempest-keypair-1070579376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-cwh23n2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=7a8c1c60-c451-4350-8460-dd46e717314a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:10:35.999863 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:36.000155 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:36.000981 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:36.015125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 86e04c9b-9512-47f6-8849-2c171e65ea18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:36.166577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Found WWN 330000000289a8a85 for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:10:36.166577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:36.166577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== connect_volume: return (3059ms) {'type': 'block', 'scsi_wwn': '330000000289a8a85', 'path': '/dev/dm-1', 'multipath_id': '330000000289a8a85'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:36.166577 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000289a8a85', 'path': '/dev/dm-1', 'multipath_id': '330000000289a8a85'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:10:36.353330 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Took 1.59 seconds to destroy the instance on the hypervisor.
May 13 02:10:36.354100 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:36.354456 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:36.354560 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:36.354831 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:36.476515 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:36.503642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] End _get_guest_xml xml=<domain type="qemu">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <uuid>7a8c1c60-c451-4350-8460-dd46e717314a</uuid>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <name>instance-0000002c</name>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1721294325</nova:name>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:10:35</nova:creationTime>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:user uuid="99b42dec2d7345d7a446924b3f75142e">tempest-VolumesSnapshotTestJSON-2040320791-project-member</nova:user>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:project uuid="179ca7073b3146308156a52a09a12713">tempest-VolumesSnapshotTestJSON-2040320791</nova:project>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         <nova:port uuid="cb581ae8-654d-4b1e-bb9e-d908d2effedf">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <system>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="serial">7a8c1c60-c451-4350-8460-dd46e717314a</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="uuid">7a8c1c60-c451-4350-8460-dd46e717314a</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </system>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <os>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </os>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <features>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </features>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   <devices>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.config"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:0b:85:79"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <target dev="tapcb581ae8-65"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </interface>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/console.log" append="off"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </serial>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <video>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </video>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </rng>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:   </devices>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]: </domain>
May 13 02:10:36.503642 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Preparing to wait for external event network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1721294325',display_name='tempest-VolumesSnapshotTestJSON-instance-1721294325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-1721294325',id=44,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqIiL9UyJ2RBSVaL84a/Sd8T1Ua2++QdyarU1MCyHUrM8+3s/kIBLxI3CUDH81eNgWyjC0opLMsEBHnoUMzXjBfowrJsT1tk8R3mXbaTbH40Qta7YL8qpmK/kwxXoSs1Q==',key_name='tempest-keypair-1070579376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-cwh23n2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=7a8c1c60-c451-4350-8460-dd46e717314a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:10:36.509170 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:36.510007 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:36.510365 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:10:36.510642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.510886 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:36.511190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:10:36.512311 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.512311 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9509424e-d21b-5e58-9f5e-7f5e3e50e267', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:36.514551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.514551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:36.516704 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.519073 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.519504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb581ae8-65, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:36.521010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb581ae8-65, col_values=(('qos', UUID('652821f9-8975-4e78-9023-dccc3653293a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:36.521010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb581ae8-65, col_values=(('external_ids', {'iface-id': 'cb581ae8-654d-4b1e-bb9e-d908d2effedf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:85:79', 'vm-uuid': '7a8c1c60-c451-4350-8460-dd46e717314a'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:36.521713 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.524429 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:36.529544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:36.530984 np0000000663 nova-compute[98103]: INFO os_vif [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65')
May 13 02:10:36.624900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:36.626823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:36.673959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1804132156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-1804132156',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-e4tr0vmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:30Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=30b0dfcd-6246-4843-a7c0-f7b3c60f8c56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:10:36.674249 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:36.674832 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:36.675534 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'pci_devices' on Instance uuid 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:36.701558 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638236.7012768, 35a03c2e-e053-46e6-bb2e-5668f555c78e => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:36.701734 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] VM Started (Lifecycle Event)
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Acquiring lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] No waiting events found dispatching network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-unplugged-b6591ce3-f1f9-4189-8cad-807133fd2e27 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Processing event network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] No waiting events found dispatching network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received unexpected event network-vif-plugged-eb257c5e-1da0-42d8-8071-669804e98690 for instance with vm_state building and task_state spawning.
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Received event network-vif-deleted-b6591ce3-f1f9-4189-8cad-807133fd2e27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Neutron deleted interface b6591ce3-f1f9-4189-8cad-807133fd2e27; detaching it from the instance and deleting it from the info cache
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:37.101075 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:10:37.108136 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:10:37.111428 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance spawned successfully.
May 13 02:10:37.111428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:10:37.128560 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Detaching volume 9761af2b-8acc-4b43-9573-3b4e37626490
May 13 02:10:37.172407 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Attempting to driver detach volume 9761af2b-8acc-4b43-9573-3b4e37626490 from mountpoint /dev/vdc
May 13 02:10:37.176053 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Found disk vdc by alias ua-9761af2b-8acc-4b43-9573-3b4e37626490 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:37.176654 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Found disk vdc by alias ua-9761af2b-8acc-4b43-9573-3b4e37626490 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:37.176886 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Attempting to detach device vdc from instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:10:37.178786 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <alias name="ua-9761af2b-8acc-4b43-9573-3b4e37626490"/>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <serial>9761af2b-8acc-4b43-9573-3b4e37626490</serial>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:37.178786 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:37.179989 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] End _get_guest_xml xml=<domain type="qemu">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <uuid>30b0dfcd-6246-4843-a7c0-f7b3c60f8c56</uuid>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <name>instance-0000002b</name>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1804132156</nova:name>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:10:33</nova:creationTime>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:user uuid="a1cbbca488aa421e8bb3c5cbacb6c4c8">tempest-AttachVolumeMultiAttachTest-2055478852-project-member</nova:user>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:project uuid="99c4c5b67d6749e98f7ab1203bb6201b">tempest-AttachVolumeMultiAttachTest-2055478852</nova:project>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         <nova:port uuid="48c8e0bf-9692-4ef5-a94d-75594b9c6c3c">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <system>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="serial">30b0dfcd-6246-4843-a7c0-f7b3c60f8c56</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="uuid">30b0dfcd-6246-4843-a7c0-f7b3c60f8c56</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </system>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <os>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </os>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <features>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </features>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   <devices>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/disk.config"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <alias name="ua-ffe3c430-ac9f-47a3-8afb-04e332b0050f"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <serial>ffe3c430-ac9f-47a3-8afb-04e332b0050f</serial>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <shareable/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:a7:f7:43"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <target dev="tap48c8e0bf-96"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </interface>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/console.log" append="off"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </serial>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <video>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </video>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </rng>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:   </devices>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]: </domain>
May 13 02:10:37.179989 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Preparing to wait for external event network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1804132156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-1804132156',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-e4tr0vmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:30Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=30b0dfcd-6246-4843-a7c0-f7b3c60f8c56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:10:37.183720 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:37.186149 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:37.189758 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:10:37.191274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.191274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:37.191274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:10:37.193749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.194009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4cf095e-782f-538e-a515-bc5a19732c58', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:37.194544 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully detached device vdc from instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc from the persistent domain config.
May 13 02:10:37.194784 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] (1/8): Attempting to detach device vdc with device alias ua-9761af2b-8acc-4b43-9573-3b4e37626490 from instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:10:37.195165 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <alias name="ua-9761af2b-8acc-4b43-9573-3b4e37626490"/>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <serial>9761af2b-8acc-4b43-9573-3b4e37626490</serial>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:37.195165 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:37.196548 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.196548 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:37.204912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.204912 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:37.207744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.207744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48c8e0bf-96, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:37.207744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48c8e0bf-96, col_values=(('qos', UUID('05590275-faf0-4374-a912-7a58a625d325')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:37.207744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48c8e0bf-96, col_values=(('external_ids', {'iface-id': '48c8e0bf-9692-4ef5-a94d-75594b9c6c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f7:43', 'vm-uuid': '30b0dfcd-6246-4843-a7c0-f7b3c60f8c56'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:37.210961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:37.212284 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:37.219854 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:37.221138 np0000000663 nova-compute[98103]: INFO os_vif [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96')
May 13 02:10:37.478230 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:37.603467 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b091f2f2-492e-4a97-a4d6-33a0fc14e2d9 req-68864cb5-92ed-472c-b09e-c245305e362f service nova] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Detach interface failed, port_id=b6591ce3-f1f9-4189-8cad-807133fd2e27, reason: Instance 4f97648c-78f1-459b-8dcb-c3d6573fb800 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:37.621442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.621663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.622118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.622455 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.622785 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.623820 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:37.715796 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:10:37.716062 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638237.71586, 35a03c2e-e053-46e6-bb2e-5668f555c78e => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:37.716237 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] VM Paused (Lifecycle Event)
May 13 02:10:37.777330 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-9761af2b-8acc-4b43-9573-3b4e37626490 for instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:10:37.980508 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Took 1.63 seconds to deallocate network for instance.
May 13 02:10:38.060236 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:38.060369 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:38.060432 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No VIF found with MAC fa:16:3e:0b:85:79, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:38.060828 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Using config drive
May 13 02:10:38.129877 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Took 9.65 seconds to spawn the instance on the hypervisor.
May 13 02:10:38.130390 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:38.221708 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:38.223660 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638238.2234504, 35a03c2e-e053-46e6-bb2e-5668f555c78e => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:38.223784 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] VM Resumed (Lifecycle Event)
May 13 02:10:38.488261 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:38.488515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:38.566475 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:38.639744 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Took 17.25 seconds to build instance.
May 13 02:10:38.711044 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Creating config drive at /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.config
May 13 02:10:38.722333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicdwaosv {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:38.737586 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:38.759549 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:38.768116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:38.768116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:38.768116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] No VIF found with MAC fa:16:3e:a7:f7:43, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:38.768116 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Using config drive
May 13 02:10:38.802451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicdwaosv" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:38.835455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:38.836699 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:39.141470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.759s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:39.141964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.672s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:39.141964 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
May 13 02:10:39.141964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:39.247131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:39.250113 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:39.265131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638239.2648125, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => ua-9761af2b-8acc-4b43-9573-3b4e37626490> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:10:39.276077 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:39.278543 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully detached device vdc from instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc from the live domain config.
May 13 02:10:39.282572 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:39.282986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:39.283183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:39.283563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:39.283937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9761af2b-8acc-4b43-9573-3b4e37626490', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:39.284025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:39.294699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:39.325029 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:39.325500 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '93')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:39.325500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '80')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:39.328253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490', '81')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:39.328614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c242160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:39.328845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Removing multipathed devices sdi, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:39.329295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flush multipath device 3300000008a9e1595 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:39.339215 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:10:39.345267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.369005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:39.407057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:39.426575 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.456937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Checking to see if SCSI volumes sdi, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:39.457166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] SCSI volumes sdi, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:39.459840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Checking to see if device paths {'sdi', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:39.480076 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Creating config drive at /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/disk.config
May 13 02:10:39.480888 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Device paths {'sdi', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:39.481401 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:39.485714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbt1ho4ez {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:39.504286 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.554269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbt1ho4ez" returned: 0 in 0.067s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:39.561120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.40.100,3260]
May 13 02:10:39.561120 np0000000663 nova-compute[98103]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.40.100,3260] successful.
May 13 02:10:39.561120 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.588061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.604249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.655973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.50.100,3260]
May 13 02:10:39.655973 np0000000663 nova-compute[98103]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-9761af2b-8acc-4b43-9573-3b4e37626490, portal: 192.168.50.100,3260] successful.
May 13 02:10:39.655973 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.681118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:39.682077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:39.682077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] <== disconnect_volume: return (399ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:39.682077 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:39.687334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.693350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.698364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.726064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.732927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:39.751367 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:39.892856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:40.041972 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.073967 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.073967 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.184893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.208958 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.210720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.242121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-85d586b5-0d51-4b99-8dd8-139131d923c6 req-89489bf9-525e-4e2c-9f02-6fc0285c9e69 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:40.243133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-85d586b5-0d51-4b99-8dd8-139131d923c6 req-89489bf9-525e-4e2c-9f02-6fc0285c9e69 service nova] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:40.243133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-85d586b5-0d51-4b99-8dd8-139131d923c6 req-89489bf9-525e-4e2c-9f02-6fc0285c9e69 service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:40.243266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-85d586b5-0d51-4b99-8dd8-139131d923c6 req-89489bf9-525e-4e2c-9f02-6fc0285c9e69 service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:40.243312 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-85d586b5-0d51-4b99-8dd8-139131d923c6 req-89489bf9-525e-4e2c-9f02-6fc0285c9e69 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Processing event network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:10:40.250811 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'flavor' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:40.261313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.773s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:40.262973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.370s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:40.273014 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:10:40.274126 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Claim successful on node np0000000663
May 13 02:10:40.332286 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Deleted allocations for instance 4f97648c-78f1-459b-8dcb-c3d6573fb800
May 13 02:10:40.340981 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638240.3406236, 7a8c1c60-c451-4350-8460-dd46e717314a => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:40.341344 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] VM Started (Lifecycle Event)
May 13 02:10:40.550119 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:40.801900 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-changed-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:40.802003 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing instance network info cache due to event network-changed-eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:40.802187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:40.802317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:40.802476 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing network info cache for port eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:40.843578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:40.846825 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638240.8465528, 7a8c1c60-c451-4350-8460-dd46e717314a => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:40.846996 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] VM Paused (Lifecycle Event)
May 13 02:10:40.982026 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:10:40.985725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:10:40.989274 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance spawned successfully.
May 13 02:10:40.989593 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:10:41.199988 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6e695e17-e34e-4e9e-ba8a-994e7d103ced req-fa920270-9257-493e-9ac3-f807e16c50f3 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:41.199988 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e695e17-e34e-4e9e-ba8a-994e7d103ced req-fa920270-9257-493e-9ac3-f807e16c50f3 service nova] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:41.199988 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e695e17-e34e-4e9e-ba8a-994e7d103ced req-fa920270-9257-493e-9ac3-f807e16c50f3 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:41.199988 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e695e17-e34e-4e9e-ba8a-994e7d103ced req-fa920270-9257-493e-9ac3-f807e16c50f3 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:41.199988 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6e695e17-e34e-4e9e-ba8a-994e7d103ced req-fa920270-9257-493e-9ac3-f807e16c50f3 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Processing event network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:10:41.201610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:10:41.206717 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:10:41.210497 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance spawned successfully.
May 13 02:10:41.210877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:10:41.258969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-238688c7-f624-45d7-b849-73c0556ed670 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.633s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:41.306308 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:41.341889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ebca51af-7a3d-43a7-95f0-0982f02a946c tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4f97648c-78f1-459b-8dcb-c3d6573fb800" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.086s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:41.349983 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:41.356264 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638241.3559277, 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:41.356605 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] VM Started (Lifecycle Event)
May 13 02:10:41.506247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.506247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.506247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.506247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.509813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.509813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.723055 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.723055 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.723438 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.723858 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.724249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.724621 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:41.860414 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:41.863781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:41.910850 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:42.015919 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Took 9.12 seconds to spawn the instance on the hypervisor.
May 13 02:10:42.017765 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:42.127117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updated VIF entry in instance network info cache for port eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:42.129616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:42.129616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:42.129616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:42.130020 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:42.132501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:42.132815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:42.137129 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Terminating instance
May 13 02:10:42.207925 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.230388 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Took 8.44 seconds to spawn the instance on the hypervisor.
May 13 02:10:42.230538 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:42.260297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:42.260610 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:42.324051 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:42.324262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:42.324393 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:42.324540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:42.324696 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] No waiting events found dispatching network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:42.324804 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-24c70955-646d-4302-bee5-21ef89c3438e req-212e9f78-8e35-4eed-939e-119b22b4aa7d service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received unexpected event network-vif-plugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c for instance with vm_state active and task_state None.
May 13 02:10:42.378145 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:10:42.378617 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638242.3782218, 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:42.378617 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] VM Paused (Lifecycle Event)
May 13 02:10:42.527732 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Took 17.41 seconds to build instance.
May 13 02:10:42.632167 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:42.632167 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:42.633548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-647f8db5-df66-4e61-8428-1a31409214bd req-949b3879-3119-4dc7-a791-0570c56e23ba service nova] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:42.642615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:42.667556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.673456 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.702406 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.709324 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.732076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.738624 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.743262 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Took 17.30 seconds to build instance.
May 13 02:10:42.765455 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:42.885072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:42.899986 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638242.8995807, 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:42.902160 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] VM Resumed (Lifecycle Event)
May 13 02:10:42.976695 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:42.988879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.014028 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Instance destroyed successfully.
May 13 02:10:43.014688 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'resources' on Instance uuid 0eb5ec8d-4f76-4777-9adc-36852d35ebbc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:43.029784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ad6d881e-d4fe-48ad-bca4-70ea485824e9 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.925s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.032865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 15.553s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:43.128087 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-changed-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:43.129485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing instance network info cache due to event network-changed-eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:43.131185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:43.131185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:43.131185 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing network info cache for port eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:43.133574 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Detaching volume 6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8
May 13 02:10:43.188987 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Attempting to driver detach volume 6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 from mountpoint /dev/vdb
May 13 02:10:43.198205 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Found disk vdb by alias ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:43.199913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Found disk vdb by alias ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:10:43.200027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Attempting to detach device vdb from instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:10:43.200297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <alias name="ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8"/>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <serial>6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8</serial>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:43.200297 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:43.209192 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Successfully detached device vdb from instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 from the persistent domain config.
May 13 02:10:43.209606 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] (1/8): Attempting to detach device vdb with device alias ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 from instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:10:43.209655 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <alias name="ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8"/>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <serial>6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8</serial>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]: </disk>
May 13 02:10:43.209655 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:10:43.247682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.817s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.274803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.012s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.275542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:10:43.328764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:43.332117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:43.337835 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:43.338225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.338542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] No waiting events found dispatching network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:43.338768 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received unexpected event network-vif-plugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf for instance with vm_state active and task_state None.
May 13 02:10:43.339067 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:43.339306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Acquiring lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] No waiting events found dispatching network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:43.341172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-860dae56-af4c-4f68-a491-56ea92144a00 req-84f393ea-65f5-4d34-91b1-cb1386b098d6 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-unplugged-80ad54cb-0c0b-4504-ae94-326b9005d7b7 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:43.409788 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:43.414836 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:43.518140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-677316047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-677316047',id=37,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPee8wUzwjPQReGLhZtrxeUFa0M4Zb++1dNjlQM/Z/y4Coy97qBkjjl0WUIgmQCOofI7a2FVZnr9Ovg/mMy5at1FCudLBbMc1J5eRRYTK+HwpyfZT7s0YFq7zNWFRDFacQ==',key_name='tempest-keypair-1729290138',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:09:58Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-emin6ih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:09:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=0eb5ec8d-4f76-4777-9adc-36852d35ebbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:43.518441 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "address": "fa:16:3e:50:17:9d", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ad54cb-0c", "ovs_interfaceid": "80ad54cb-0c0b-4504-ae94-326b9005d7b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:43.519529 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:43.519529 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:43.520539 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.520882 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80ad54cb-0c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:43.522863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.524260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:43.525820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.525820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77d31552-5a50-4359-969f-9d249427db7e) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:43.530106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.530106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:43.530106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:43.532126 np0000000663 nova-compute[98103]: INFO os_vif [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:17:9d,bridge_name='br-int',has_traffic_filtering=True,id=80ad54cb-0c0b-4504-ae94-326b9005d7b7,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ad54cb-0c')
May 13 02:10:43.532444 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Deleting instance files /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc_del
May 13 02:10:43.538438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.508s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:43.539781 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Deletion of /opt/stack/data/nova/instances/0eb5ec8d-4f76-4777-9adc-36852d35ebbc_del complete
May 13 02:10:43.634744 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:43.780411 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:10:43.780411 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:10:43.780571 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:43.780693 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:43.895476 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3cc512843b427fa59414fdf92f5e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97b10a192fd43f689e55b4537a4f824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:10:43.916226 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638243.9158275, 7a8c1c60-c451-4350-8460-dd46e717314a => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:43.916415 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] VM Resumed (Lifecycle Event)
May 13 02:10:43.951823 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 for instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:10:44.059238 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 02:10:44.060026 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:44.063397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:44.063541 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:44.063734 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:44.164310 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:44.190776 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:44.290134 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:10:44.361980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:44.362288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:44.362420 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Shelve offloading
May 13 02:10:44.405926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-changed-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:44.405926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Refreshing instance network info cache due to event network-changed-cb581ae8-654d-4b1e-bb9e-d908d2effedf. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:44.405926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] Acquiring lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:44.405926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] Acquired lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:44.405926 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Refreshing network info cache for port cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:44.408670 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updated VIF entry in instance network info cache for port eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:44.409003 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:44.420283 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:44.432214 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:44.694784 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Successfully created port: 28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:10:44.796285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:10:44.911051 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:44.915587 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dfbea494-ad75-4756-b1ba-6198e1405aca req-492ef93c-1c75-4e7f-a3bf-b5113029b94d service nova] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:44.936073 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999593784999888 future=<Future at 0x705c6c2b74d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:44.936333 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638244.935995, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => ua-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:10:44.941347 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Successfully detached device vdb from instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 from the live domain config.
May 13 02:10:44.943173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:44.943743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:44.944058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:44.945023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:44.945482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:44.945758 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:44.982896 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:44.983310 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:44.983310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '93')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:44.983630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '79')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:44.985954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8', '78')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:44.987867 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c5620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'): ({'sdj'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:44.988268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:44.989011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Flush multipath device 330000000a0053ff7 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:45.024389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:45.084598 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:45.144753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:45.144753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:45.145840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:45.162714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:45.162714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:45.181482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.205983 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:45.216287 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ea7d73fc-af46-4664-a989-12cf1e03a024 req-997f1ab5-b1ce-4e1f-8721-cc79f9b65f63 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Received event network-vif-deleted-80ad54cb-0c0b-4504-ae94-326b9005d7b7 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:45.218853 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-ea7d73fc-af46-4664-a989-12cf1e03a024 req-997f1ab5-b1ce-4e1f-8721-cc79f9b65f63 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Neutron deleted interface 80ad54cb-0c0b-4504-ae94-326b9005d7b7; detaching it from the instance and deleting it from the info cache
May 13 02:10:45.218853 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ea7d73fc-af46-4664-a989-12cf1e03a024 req-997f1ab5-b1ce-4e1f-8721-cc79f9b65f63 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:45.220899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.40.100,3260]
May 13 02:10:45.220899 np0000000663 nova-compute[98103]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.40.100,3260] successful.
May 13 02:10:45.220899 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.245761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.259197 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.309322 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:45.312066 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.50.100,3260]
May 13 02:10:45.312066 np0000000663 nova-compute[98103]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-6cc05dcf-fb1e-4478-9571-7ab2a6c49cc8, portal: 192.168.50.100,3260] successful.
May 13 02:10:45.312066 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.329278 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Successfully updated port: 28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:10:45.333977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:45.334707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:45.334947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] <== disconnect_volume: return (391ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:45.335081 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:45.400023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:45.407020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:45.431885 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:45.467009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:45.548382 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updated VIF entry in instance network info cache for port cb581ae8-654d-4b1e-bb9e-d908d2effedf. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:45.548685 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating instance_info_cache with network_info: [{"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:45.551468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:45.710416 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Took 1.65 seconds to deallocate network for instance.
May 13 02:10:45.733175 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ea7d73fc-af46-4664-a989-12cf1e03a024 req-997f1ab5-b1ce-4e1f-8721-cc79f9b65f63 service nova] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Detach interface failed, port_id=80ad54cb-0c0b-4504-ae94-326b9005d7b7, reason: Instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:45.756747 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999725329000285 future=<Future at 0x705c6c1b1ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:45.760818 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance destroyed successfully.
May 13 02:10:45.761328 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:45.814144 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:10:45.815214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:10:45.815370 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Creating image(s)
May 13 02:10:45.816024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:45.816922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:45.817444 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:45.819137 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:45.821868 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:45.823110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:45.853164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:45.853383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquired lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:45.853742 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:45.916866 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'flavor' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:45.930915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:45.931408 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:45.931880 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:45.932459 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:45.936831 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:10:45.938060 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:46.043107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:46.043524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:46.060562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b0242455-d505-4569-a6c2-7d90f8df4719 req-18b5a23a-b42c-4949-bcae-58fd487a9664 service nova] Releasing lock "refresh_cache-7a8c1c60-c451-4350-8460-dd46e717314a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:46.098989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk 1073741824" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:46.099397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:46.099815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:46.212036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:46.212700 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:10:46.213241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:46.234874 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:46.235692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:46.264656 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:46.267990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:46.268153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:46.268336 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:10:46.339908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:46.340443 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:10:46.340926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:10:46.341173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Ensure instance console log exists: /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:10:46.341479 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:46.341762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:46.341960 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:46.479351 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:10:46.508255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-changed-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:46.508372 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Refreshing instance network info cache due to event network-changed-28c5c508-74e7-4622-8bbe-b35276f1e65c. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:46.508509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] Acquiring lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:46.755808 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:46.772034 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:46.928526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9ccb7add-49de-4449-8488-ab29eef4d04f tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.297s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:46.961339 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:47.187333 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:47.188030 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:47.206179 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:47.328562 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:47.329274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.329444 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.329582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:47.329777 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:47.329909 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received unexpected event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with vm_state active and task_state shelving.
May 13 02:10:47.330054 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:47.330208 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.330382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.330445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:47.330553 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:47.330700 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-62fa5c94-b5d4-4df7-a15f-4d00a0b51885 req-dcdc109f-2e74-4525-860d-6f9398160a33 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received unexpected event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with vm_state active and task_state shelving.
May 13 02:10:47.380839 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:47.465650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Releasing lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:47.466053 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance network_info: |[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:10:47.466333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] Acquired lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:47.466424 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Refreshing network info cache for port 28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:47.469879 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start _get_guest_xml network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:10:47.473979 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:10:47.476551 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-101663398', uuid='0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'), owner=OwnerMeta(userid='3b3cc512843b427fa59414fdf92f5e76', username='tempest-AttachVolumeTestJSON-1185409082-project-member', projectid='c97b10a192fd43f689e55b4537a4f824', projectname='tempest-AttachVolumeTestJSON-1185409082'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638247.4759243) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:10:47.478517 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:10:47.479405 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:10:47.481751 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:10:47.482085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:10:47.484374 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:10:47.484917 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:10:47.485288 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:10:47.485549 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:10:47.489226 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:10:47.499478 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:10:47.500186 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:47.501078 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:47.502032 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:47.551327 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.551503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.551818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.551990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.552147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:47.554627 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Terminating instance
May 13 02:10:47.606163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.606163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.606163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:47.606163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:47.606163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:47.607180 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Terminating instance
May 13 02:10:47.690463 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:47.883012 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:47.883435 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:47.883794 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:47.971123 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:48.005680 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] End _get_guest_xml xml=<domain type="qemu">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <uuid>0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</uuid>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <name>instance-0000002d</name>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeTestJSON-server-101663398</nova:name>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:10:47</nova:creationTime>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:user uuid="3b3cc512843b427fa59414fdf92f5e76">tempest-AttachVolumeTestJSON-1185409082-project-member</nova:user>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:project uuid="c97b10a192fd43f689e55b4537a4f824">tempest-AttachVolumeTestJSON-1185409082</nova:project>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         <nova:port uuid="28c5c508-74e7-4622-8bbe-b35276f1e65c">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <system>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="serial">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="uuid">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </system>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <os>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </os>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <features>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </features>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   <devices>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </disk>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:77:23:1c"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <target dev="tap28c5c508-74"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </interface>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/console.log" append="off"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </serial>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <video>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </video>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </rng>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:   </devices>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]: </domain>
May 13 02:10:48.005680 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:10:48.010070 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Preparing to wait for external event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:10:48.010070 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:48.010070 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:48.010070 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:48.012172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:10:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:10:48.012172 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:48.012172 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:48.013237 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:10:48.017145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.017617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:48.017970 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:10:48.022332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.022915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0d0df4c-23da-5f98-be2f-42d81ff94be5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:48.023487 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.024147 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:48.031516 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.035638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.035895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c5c508-74, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:48.036419 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28c5c508-74, col_values=(('qos', UUID('2a03d970-ca9c-4450-9c80-f26bfc91286c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:48.038580 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28c5c508-74, col_values=(('external_ids', {'iface-id': '28c5c508-74e7-4622-8bbe-b35276f1e65c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:23:1c', 'vm-uuid': '0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:48.039611 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.041288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:48.056382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.059140 np0000000663 nova-compute[98103]: INFO os_vif [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:10:48.061123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:48.113348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.124536 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:10:48.148439 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.173072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.184511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.198863 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.963s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:48.203812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.277349 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Deleted allocations for instance 0eb5ec8d-4f76-4777-9adc-36852d35ebbc
May 13 02:10:48.337384 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.362565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.387508 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.419811 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.440206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:48.450360 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:48.538012 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999628147999829 future=<Future at 0x705c4871b440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:48.545724 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Instance destroyed successfully.
May 13 02:10:48.547246 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:48.555585 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999618481000198 future=<Future at 0x705c6c6c3d10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:48.557722 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Instance destroyed successfully.
May 13 02:10:48.558511 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lazy-loading 'resources' on Instance uuid b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:48.585368 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance destroyed successfully.
May 13 02:10:48.585799 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'resources' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:48.623150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:48.623669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:48.623965 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:48.624297 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:48.624919 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] No waiting events found dispatching network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:48.624919 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ded9dd1f-5dbb-4ebb-a7c8-c7bac36c81b8 req-3476641e-8b2b-4c12-a1dc-7c20192ec7c1 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:48.652340 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:48.652463 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing instance network info cache due to event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:48.652623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:48.653114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:48.653114 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:48.695586 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updated VIF entry in instance network info cache for port 28c5c508-74e7-4622-8bbe-b35276f1e65c. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:48.696200 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:49.052450 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1804132156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-1804132156',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:42Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-e4tr0vmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:42Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=30b0dfcd-6246-4843-a7c0-f7b3c60f8c56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:49.052721 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "address": "fa:16:3e:a7:f7:43", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48c8e0bf-96", "ovs_interfaceid": "48c8e0bf-9692-4ef5-a94d-75594b9c6c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:49.056116 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:49.056116 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:49.056116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.056116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48c8e0bf-96, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.056116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.056594 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.063631 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-592188464',display_name='tempest-ServerStableDeviceRescueTest-server-592188464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-serverstabledevicerescuetest-server-592188464',id=36,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzDp/iyzFWE16MhS1cHYitjK+qGSRXAJhbgNOwBMlaTtO0N/gf+8RLfV6FWr9beX98956BGPdKq/GVVrrOgxASAg4p1dYvuTVnd3mwysylQdtQ8ikEZPxdZcxL5A4yvfA==',key_name='tempest-keypair-1887025731',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:03Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89cd0ac04b144296b82948ab2abe19a8',ramdisk_id='',reservation_id='r-fsvbfaex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1052023346',owner_user_name='tempest-ServerStableDeviceRescueTest-1052023346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3389815009742f7b71399449ef041ce',uuid=b30e4097-0d76-4cae-a3d4-175cd5c6c5a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:49.063870 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converting VIF {"id": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "address": "fa:16:3e:7d:2e:e1", "network": {"id": "69b90b3a-b8aa-45d9-b61c-6aae0bf92c85", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2014789971-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89cd0ac04b144296b82948ab2abe19a8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a80ff1d-8a", "ovs_interfaceid": "2a80ff1d-8a2e-411d-8a2d-ea257e40f944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:49.064452 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:49.064776 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:49.073565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.074316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.074537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a80ff1d-8a, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.077192 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.078574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.087787 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Object Instance<6ba96da7-7f37-4f58-bb18-cc1196420d0c> lazy-loaded attributes: numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:10:49.088566 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNHjRx8Ie8JjdF7ibpIk1pSDVp6aIBHI4BtA+dmDB063keYC9/wUS5YBOeJj3qqSu5AO1rTcliDXP7qi+k6voVjl7VkbCp1kCgtVu8f0XDcRNKhun58Mdf+xQ3pYvF5ow==',key_name='tempest-TestShelveInstance-1178221670',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:03Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:10:49.089006 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.089385 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:10:49.090084 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:10:49.090447 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:10:49.092322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.094038 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05590275-faf0-4374-a912-7a58a625d325) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.096964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.097520 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.106656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.107414 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.108714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eeca926f-a4aa-4c41-88fc-c116ec3a466a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.109456 np0000000663 nova-compute[98103]: INFO os_vif [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f7:43,bridge_name='br-int',has_traffic_filtering=True,id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48c8e0bf-96')
May 13 02:10:49.113337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.120673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.121411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.122168 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c6fa8b-e0, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.124318 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.127377 np0000000663 nova-compute[98103]: INFO os_vif [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:2e:e1,bridge_name='br-int',has_traffic_filtering=True,id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944,network=Network(69b90b3a-b8aa-45d9-b61c-6aae0bf92c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a80ff1d-8a')
May 13 02:10:49.127843 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Deleting instance files /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9_del
May 13 02:10:49.129873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.131029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.131362 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Deletion of /opt/stack/data/nova/instances/b30e4097-0d76-4cae-a3d4-175cd5c6c5a9_del complete
May 13 02:10:49.133540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=021c3cfc-654f-4e7e-ad46-7ca01cc1a4fa) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:10:49.134159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.134761 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:10:49.141328 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:49.143531 np0000000663 nova-compute[98103]: INFO os_vif [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0')
May 13 02:10:49.145042 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:49.145410 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:49.145616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:49.146121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:49.146445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:49.146610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:49.159494 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:49.168547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:10:49.171233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:49.171233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a (non-flash)
May 13 02:10:49.179555 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [83] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a (non-flash)
May 13 02:10:49.179918 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:49.179918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a', '94')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:49.180724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '82')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:49.181025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '83')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:49.181729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c243740>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:49.181938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Removing multipathed devices sdm, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:49.182213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flush multipath device 33000000053051faa {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:49.200221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3488f6f8-7b9d-4972-9632-ad90214dba17 req-294be03c-0c60-4086-8a43-ef4f29ed0d55 service nova] Releasing lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:49.233611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:49.275938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:49.288854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-eaffaf51-c057-4709-9930-817cd93fcac9 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "0eb5ec8d-4f76-4777-9adc-36852d35ebbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.159s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:49.338121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:49.338391 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:49.340373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:49.355638 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:49.355922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:49.370999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.418933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 82, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260]
May 13 02:10:49.418933 np0000000663 nova-compute[98103]: Logout of [sid: 82, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260] successful.
May 13 02:10:49.418933 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.440715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.457245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.497965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260]
May 13 02:10:49.497965 np0000000663 nova-compute[98103]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260] successful.
May 13 02:10:49.497965 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.520305 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.520553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:49.520930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== disconnect_volume: return (375ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:49.521066 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:49.521595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:10:49.522068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ffe3c430-ac9f-47a3-8afb-04e332b0050f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:10:49.525490 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deleting instance files /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c_del
May 13 02:10:49.525903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:10:49.526709 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deletion of /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c_del complete
May 13 02:10:49.562007 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a (non-flash)
May 13 02:10:49.564697 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [92] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [93] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a (non-flash)
May 13 02:10:49.564974 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:10:49.565265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '92'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8c17dbd8-8167-4fba-bd80-9dac354a001a', '94')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:10:49.565440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '93')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:49.566925 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f', '92')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:10:49.567975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48726840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:10:49.568232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Removing multipathed devices sdh, sde {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:10:49.568490 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flush multipath device 330000000289a8a85 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:10:49.603747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:49.603887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:10:49.604177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:77:23:1c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:10:49.604738 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Using config drive
May 13 02:10:49.627582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:49.640401 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Took 1.52 seconds to destroy the instance on the hypervisor.
May 13 02:10:49.641824 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:49.641824 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:49.641824 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:49.642075 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:49.675959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:10:49.719500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if SCSI volumes sdh, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:10:49.719766 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] SCSI volumes sdh, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:10:49.722143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if device paths {'sdh', 'sde'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:10:49.737404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Device paths {'sdh', 'sde'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:10:49.737404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:10:49.758975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.764143 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updated VIF entry in instance network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:49.764381 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": null, "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:49.803685 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:49.805958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.40.100,3260]
May 13 02:10:49.805958 np0000000663 nova-compute[98103]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.40.100,3260] successful.
May 13 02:10:49.805958 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.832647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.848167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.887276 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.50.100,3260]
May 13 02:10:49.887276 np0000000663 nova-compute[98103]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-ffe3c430-ac9f-47a3-8afb-04e332b0050f, portal: 192.168.50.100,3260] successful.
May 13 02:10:49.887276 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.911392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:10:49.911392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:10:49.911392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== disconnect_volume: return (742ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:49.911392 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:10:49.911392 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Deleting instance files /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56_del
May 13 02:10:49.912978 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Deletion of /opt/stack/data/nova/instances/30b0dfcd-6246-4843-a7c0-f7b3c60f8c56_del complete
May 13 02:10:50.111033 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:50.276664 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0d14a1b-cb4d-482b-a67c-01fe308a6e8a req-910e8d87-2861-4eb1-bf88-7c1fb6955119 service nova] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:50.306532 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004253120000612398 future=<Future at 0x705c487349b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:50.307060 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:50.308253 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Emitting event <LifecycleEvent: 1778638235.3059323, 4f97648c-78f1-459b-8dcb-c3d6573fb800 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:50.308583 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.626894303999961 future=<Future at 0x705c6c2b74d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:50.308916 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] VM Stopped (Lifecycle Event)
May 13 02:10:50.310387 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.625128693000079 future=<Future at 0x705c6c2b74d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:50.416818 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Creating config drive at /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config
May 13 02:10:50.420926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpepg5lebp {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:50.452203 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Took 2.39 seconds to destroy the instance on the hypervisor.
May 13 02:10:50.453844 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:10:50.455203 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:10:50.455385 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:10:50.456230 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:50.496026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpepg5lebp" returned: 0 in 0.075s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:10:50.546364 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:50.551913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:50.764183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69516985-06f9-4b09-8830-71af345ab4f3 req-7c55c1b8-32a5-48b0-83e3-905ceac3f681 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-deleted-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:50.766659 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-69516985-06f9-4b09-8830-71af345ab4f3 req-7c55c1b8-32a5-48b0-83e3-905ceac3f681 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Neutron deleted interface 2a80ff1d-8a2e-411d-8a2d-ea257e40f944; detaching it from the instance and deleting it from the info cache
May 13 02:10:50.766659 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69516985-06f9-4b09-8830-71af345ab4f3 req-7c55c1b8-32a5-48b0-83e3-905ceac3f681 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:50.776548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:50.776548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Acquiring lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:50.777169 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] No waiting events found dispatching network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-unplugged-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Acquiring lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:50.780155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] No waiting events found dispatching network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:50.780756 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f506e749-d7c8-4eb1-afb1-cb0d2dcd868f req-5e7226ce-5278-48f5-a18e-ef77b03ad38c service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Received event network-vif-unplugged-2a80ff1d-8a2e-411d-8a2d-ea257e40f944 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:10:50.801434 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:50.812505 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 4f97648c-78f1-459b-8dcb-c3d6573fb800] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:50.965177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7499bdc6-5a13-41d6-b2ca-572d37f19c97 req-4d6fab31-d9ee-4b3f-bd69-10175e955a74 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Received event network-vif-deleted-48c8e0bf-9692-4ef5-a94d-75594b9c6c3c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:50.965322 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-7499bdc6-5a13-41d6-b2ca-572d37f19c97 req-4d6fab31-d9ee-4b3f-bd69-10175e955a74 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Neutron deleted interface 48c8e0bf-9692-4ef5-a94d-75594b9c6c3c; detaching it from the instance and deleting it from the info cache
May 13 02:10:50.965453 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7499bdc6-5a13-41d6-b2ca-572d37f19c97 req-4d6fab31-d9ee-4b3f-bd69-10175e955a74 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:51.032329 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.067368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.179129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.288800 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69516985-06f9-4b09-8830-71af345ab4f3 req-7c55c1b8-32a5-48b0-83e3-905ceac3f681 service nova] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Detach interface failed, port_id=2a80ff1d-8a2e-411d-8a2d-ea257e40f944, reason: Instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:51.307134 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Took 1.66 seconds to deallocate network for instance.
May 13 02:10:51.378470 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Deleted allocations for instance 6ba96da7-7f37-4f58-bb18-cc1196420d0c
May 13 02:10:51.394592 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:51.408791 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.414708 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.418282 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.422273 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.452012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:51.476429 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7499bdc6-5a13-41d6-b2ca-572d37f19c97 req-4d6fab31-d9ee-4b3f-bd69-10175e955a74 service nova] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Detach interface failed, port_id=48c8e0bf-9692-4ef5-a94d-75594b9c6c3c, reason: Instance 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:10:51.816411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:51.817357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:51.886999 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:51.889631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:51.890115 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:51.890313 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:10:51.890661 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:51.907586 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Took 1.45 seconds to deallocate network for instance.
May 13 02:10:52.114747 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638252.1142888, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:52.115328 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Started (Lifecycle Event)
May 13 02:10:52.506502 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Took 0.60 seconds to detach 1 volumes for instance.
May 13 02:10:52.532548 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:52.532823 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:52.622551 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:52.624945 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638252.6247342, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:52.625076 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Paused (Lifecycle Event)
May 13 02:10:52.863408 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:52.863469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:52.867477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:52.867730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:52.867861 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Processing event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:10:52.868577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:52.868790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:52.870501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:52.870501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:52.870501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:10:52.870501 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a2b7cd2b-8e56-4c9e-826a-494f1b1fd1f0 req-079a0c47-9760-4243-8b5e-ab2a4ed546bc service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state building and task_state spawning.
May 13 02:10:52.870501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:10:52.879203 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:10:52.883767 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance spawned successfully.
May 13 02:10:52.884214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:10:53.014948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:53.036203 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:53.063716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:53.064017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:53.127670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:53.130674 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638253.130405, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:53.130824 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Resumed (Lifecycle Event)
May 13 02:10:53.414385 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.414537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.416080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.416979 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.417832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.418785 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:10:53.548320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.731s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:53.557534 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.666s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:53.574581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:10:53.588827 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:53.633270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:53.639824 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:10:53.652521 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Deleted allocations for instance b30e4097-0d76-4cae-a3d4-175cd5c6c5a9
May 13 02:10:53.884576 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:53.884810 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:53.885290 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:53.943844 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Took 8.13 seconds to spawn the instance on the hypervisor.
May 13 02:10:53.944375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:10:54.136124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:54.145930 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:10:54.161725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:54.340520 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:54.340750 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:54.454023 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Took 14.61 seconds to build instance.
May 13 02:10:54.672999 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c89e6b0-d14a-41f7-af0e-959120ecad00 tempest-ServerStableDeviceRescueTest-1052023346 tempest-ServerStableDeviceRescueTest-1052023346-project-member] Lock "b30e4097-0d76-4cae-a3d4-175cd5c6c5a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.068s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:54.844843 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:54.956943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c816f051-f2fd-4e65-a8b3-d645a77257a3 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.120s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:55.245677 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-changed-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:10:55.246201 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Refreshing instance network info cache due to event network-changed-28c5c508-74e7-4622-8bbe-b35276f1e65c. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:10:55.246201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] Acquiring lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:10:55.246201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] Acquired lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:10:55.246600 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Refreshing network info cache for port 28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:10:55.371206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.814s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:55.372927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.354s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:55.558795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:55.752188 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:55.882137 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-650aa945-86ac-4a1e-86ac-a22844a86487 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 11.519s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:55.886120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 2.296s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:55.886120 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Unshelving
May 13 02:10:55.892618 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:55.894664 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:10:56.186122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:56.186454 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:56.292006 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:10:56.436616 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updated VIF entry in instance network info cache for port 28c5c508-74e7-4622-8bbe-b35276f1e65c. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:10:56.437057 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:10:56.689387 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:56.885052 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:56.886509 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:56.887734 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:10:56.902782 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Booting with volume efc2745e-bc3c-477d-a178-41ebcfb4c8f6 at /dev/vda
May 13 02:10:56.940357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-734dda47-f9a3-42f4-a249-553f93d4cf99 req-3f83aaa3-de6d-44e9-8e7c-ff9dc47229c9 service nova] Releasing lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:10:56.953456 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:10:56.967233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:10:56.994483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:10:57.047385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:10:57.047480 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:10:57.064600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:10:57.064600 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe83:8dae', 'fe80::fc16:3eff:fe53:33ed', 'fe80::fc16:3eff:fe63:4777', 'fe80::fc16:3eff:fe8d:d0e5', 'fe80::449e:8fff:fea0:d122', 'fe80::fc16:3eff:fe0b:8579', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5'] 
May 13 02:10:57.064967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:10:57.064967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:10:57.065123 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:10:57.067339 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating existing volume attachment record: 8931c3ff-eb32-4f2d-8cc8-b4ca38106a26 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:10:57.198210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.829s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:57.200162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:57.206170 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:10:57.206170 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Claim successful on node np0000000663
May 13 02:10:57.292478 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56
May 13 02:10:57.402250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:58.307941 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d2199e0-9ed1-479a-ada9-a216acba8711 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "30b0dfcd-6246-4843-a7c0-f7b3c60f8c56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.756s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:58.805307 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:10:58.806293 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:10:58.806650 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:10:59.010463 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:59.140020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:10:59.311684 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:10:59.826274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.624s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:59.826274 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:10:59.829242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.427s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:59.829413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:10:59.829967 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:10:59.830617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.026s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:10:59.835537 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'pci_requests' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:10:59.935945 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004459570000108215 future=<Future at 0x705c6c2b74d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:59.936050 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:59.936190 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.8201266600003692 future=<Future at 0x705c6c1b1ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:59.936894 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Emitting event <LifecycleEvent: 1778638244.9353857, 0eb5ec8d-4f76-4777-9adc-36852d35ebbc => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:10:59.937139 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.8191910320001625 future=<Future at 0x705c6c1b1ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:10:59.937363 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] VM Stopped (Lifecycle Event)
May 13 02:11:00.334625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:11:00.335133 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:11:00.335249 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:00.335606 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:00.340936 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:00.421045 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2554c8defe944528a06bbfd6f360dcd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '635951473383437bbabc3b1bb776416a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:11:00.439994 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 0eb5ec8d-4f76-4777-9adc-36852d35ebbc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:00.558527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:00.756668 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00031362099980469793 future=<Future at 0x705c6c1b1ca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:00.757038 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:00.757181 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=2.780222438999772 future=<Future at 0x705c4871b440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:00.757274 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=2.7801174440000977 future=<Future at 0x705c4871b440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:00.759411 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] Emitting event <LifecycleEvent: 1778638245.756255, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:00.759743 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Stopped (Lifecycle Event)
May 13 02:11:00.843545 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:11:00.847969 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:11:00.848248 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Claim successful on node np0000000663
May 13 02:11:00.891325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.004584 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.005162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.046666 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Successfully created port: e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:11:01.122494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.128202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.234618 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.235268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.278079 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-74fd5325-9037-4e07-8fc1-cd28b20547c5 tempest-VolumesActionsTest-1868975691 tempest-VolumesActionsTest-1868975691-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:01.353250 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:11:01.368009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.373357 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:11:01.374080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.484291 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.484811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.584449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.590108 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.668238 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Successfully updated port: e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:11:01.697312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.698322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.714752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:01.715158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:01.715583 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:01.715801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:01.716015 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:01.724310 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Terminating instance
May 13 02:11:01.742672 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:01.742804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing instance network info cache due to event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:11:01.743364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:01.743754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:01.744397 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:11:01.797992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.803775 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:11:01.805081 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:01.905689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:01.909136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.003707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.007356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.103701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.107113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.172912 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:02.210970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.218896 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:11:02.218896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.242077 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:02.251850 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:02.272178 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.272841 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=11406MB free_disk=73.00173950195312GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:11:02.272841 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:02.276222 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.279941 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.305520 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.358835 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:11:02.381793 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:11:02.383334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:11:02.383735 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating image(s)
May 13 02:11:02.387110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:02.387110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:02.387110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:02.387110 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:11:02.390682 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:11:02.391912 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.442692 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.448611 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.476335 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:02.476682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:02.476682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:02.476793 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:02.476924 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:02.477076 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c1085dcf-a3db-43cb-ac17-87d2663b72a6 req-884a74f5-0fe6-4863-89b8-79dae37cd752 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:02.517599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.518931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:02.519432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:02.520001 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:11:02.524523 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:11:02.525190 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.581126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.591316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:02.626295 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99956870799997 future=<Future at 0x705c4876e330 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:02.634148 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Instance destroyed successfully.
May 13 02:11:02.636355 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid 1fb86ac1-3a61-4254-83b6-b79416254ca5 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:02.640647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.641120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.641857 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:02.661152 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:02.676119 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:02.715458 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk 1073741824" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.716046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:02.716423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.831226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.831746 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:11:02.832027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:02.935380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:02.935380 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Cannot resize image /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:11:02.935651 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:11:02.935828 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Ensure instance console log exists: /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:11:02.936102 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:02.936377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:02.936520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:03.140279 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=33,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:09:37Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2y0gghuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:09:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=1fb86ac1-3a61-4254-83b6-b79416254ca5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:03.140569 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "c6888479-6ed8-4506-a6b4-b4627245a79f", "address": "fa:16:3e:63:47:77", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6888479-6e", "ovs_interfaceid": "c6888479-6ed8-4506-a6b4-b4627245a79f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:03.141565 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:03.141952 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:03.143764 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.144146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6888479-6e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:03.145501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.147145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:03.147145 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.147992 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.148191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb754caa-91ee-4ba1-a901-59b4e3ad70d5) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:03.148744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.149236 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:03.150231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:03.152228 np0000000663 nova-compute[98103]: INFO os_vif [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:47:77,bridge_name='br-int',has_traffic_filtering=True,id=c6888479-6ed8-4506-a6b4-b4627245a79f,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6888479-6e')
May 13 02:11:03.152626 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Deleting instance files /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_del
May 13 02:11:03.160058 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Deletion of /opt/stack/data/nova/instances/1fb86ac1-3a61-4254-83b6-b79416254ca5_del complete
May 13 02:11:03.180105 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:03.187005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9042b683-34cc-407b-adf7-8140e2f84aa3 req-31aa244b-ce86-4d3d-a933-aeac7c1e118a service nova] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:03.187195 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:03.187635 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:11:03.537886 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00043558600009419024 future=<Future at 0x705c4871b440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.538394 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638248.537332, 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:03.538394 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.538589 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] VM Stopped (Lifecycle Event)
May 13 02:11:03.539784 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.015316898000037327 future=<Future at 0x705c6c6c3d10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.540430 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.014656622000075004 future=<Future at 0x705c6c6c3d10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.555482 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0003421719998186745 future=<Future at 0x705c6c6c3d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.555614 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.555653 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.070083664999856 future=<Future at 0x705c4876e330 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.555712 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.070000449999952 future=<Future at 0x705c4876e330 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:03.556463 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638248.5550332, b30e4097-0d76-4cae-a3d4-175cd5c6c5a9 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:03.556715 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] VM Stopped (Lifecycle Event)
May 13 02:11:03.667509 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Took 1.43 seconds to destroy the instance on the hypervisor.
May 13 02:11:03.668534 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:03.668816 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:03.668932 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:03.669266 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:03.690060 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.859s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:03.690374 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:03.693259 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.418s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:03.735874 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:03.773354 np0000000663 nova-compute[98103]: INFO nova.network.neutron [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating port 23c6fa8b-e040-4780-8aea-8f914748d497 with attributes {'binding:host_id': 'np0000000663', 'device_owner': 'compute:nova'}
May 13 02:11:03.787170 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:11:03.970165 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:04.041461 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 30b0dfcd-6246-4843-a7c0-f7b3c60f8c56] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:04.059979 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: b30e4097-0d76-4cae-a3d4-175cd5c6c5a9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:04.209855 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edfba71e-4968-434c-a2b3-9d4960e93a72 req-9094460c-8e01-40e3-a227-8429ccbd5cfa service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-deleted-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:04.211282 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-edfba71e-4968-434c-a2b3-9d4960e93a72 req-9094460c-8e01-40e3-a227-8429ccbd5cfa service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Neutron deleted interface c6888479-6ed8-4506-a6b4-b4627245a79f; detaching it from the instance and deleting it from the info cache
May 13 02:11:04.211774 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-edfba71e-4968-434c-a2b3-9d4960e93a72 req-9094460c-8e01-40e3-a227-8429ccbd5cfa service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:04.215843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:04.409806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:04.409919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:04.410053 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:11:04.470699 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:04.471938 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing instance network info cache due to event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:11:04.472110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:04.529103 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:04.529359 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] Acquiring lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:04.529683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:04.529683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:04.529814 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] No waiting events found dispatching network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:04.529986 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1221b10b-72e9-4e63-8ede-6e1b87bd92a6 req-4d5ee48c-9723-421e-bc11-3c2577061d61 service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Received event network-vif-unplugged-c6888479-6ed8-4506-a6b4-b4627245a79f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:04.638482 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:04.718900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:04.720426 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance network_info: |[{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:11:04.723016 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start _get_guest_xml network_info=[{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:11:04.727585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edfba71e-4968-434c-a2b3-9d4960e93a72 req-9094460c-8e01-40e3-a227-8429ccbd5cfa service nova] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Detach interface failed, port_id=c6888479-6ed8-4506-a6b4-b4627245a79f, reason: Instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:11:04.727585 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:11:04.727585 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-784631415', uuid='94b0397a-4725-422f-97f8-32d7b09d5c18'), owner=OwnerMeta(userid='2554c8defe944528a06bbfd6f360dcd4', username='tempest-AttachVolumeShelveTestJSON-970754436-project-member', projectid='635951473383437bbabc3b1bb776416a', projectname='tempest-AttachVolumeShelveTestJSON-970754436'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638264.726217) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:11:04.727787 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:11:04.727954 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:11:04.728888 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:11:04.729085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:11:04.729966 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:11:04.730253 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:11:04.730413 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:11:04.730529 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:11:04.730732 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:11:04.730832 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:11:04.730941 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:11:04.731083 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:11:04.731200 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:11:04.731310 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:11:04.731409 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:11:04.731554 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:11:04.742590 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoG38eRWKMTGsvpWosYiMin4smUcwcvBohNKwIWkgz90ZYwa4McR0N3k8G7cYX3YOxDixo3/iB71DluH6n0Nl7u031kYLRxzljgfyKObdoMrxQQ5w8sLr5p2ZFqhA3bvQ==',key_name='tempest-keypair-2087693019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:11:04.742808 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:04.743546 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:04.744385 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:04.778815 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cbbe0827-c00e-48cf-92c5-9246a81c635c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.778815 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 2d1c8212-2a2a-4392-89cb-410a0a987de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.778909 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.778981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 035777fc-feb7-4c85-97f5-322ea3fb60a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.779076 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1fb86ac1-3a61-4254-83b6-b79416254ca5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 35a03c2e-e053-46e6-bb2e-5668f555c78e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 7a8c1c60-c451-4350-8460-dd46e717314a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 94b0397a-4725-422f-97f8-32d7b09d5c18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 6ba96da7-7f37-4f58-bb18-cc1196420d0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:11:04.780511 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:11:04.780876 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:11:02 up 34 min,  2 users,  load average: 8.05, 7.53, 4.39\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_99c4c5b67d6749e98f7ab1203bb6201b': '5', 'io_workload': '1', 'num_task_deleting': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '2', 'num_proj_ed9f3615db854b36b4bf3041cc0f1bb3': '1', 'num_proj_c7626320b52f49c0888006226eb492ce': '1', 'num_proj_179ca7073b3146308156a52a09a12713': '1', 'num_proj_c97b10a192fd43f689e55b4537a4f824': '1', 'num_vm_building': '1', 'num_proj_635951473383437bbabc3b1bb776416a': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:11:04.922632 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:05.140549 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Took 1.47 seconds to deallocate network for instance.
May 13 02:11:05.248686 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] End _get_guest_xml xml=<domain type="qemu">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <uuid>94b0397a-4725-422f-97f8-32d7b09d5c18</uuid>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <name>instance-0000002e</name>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-784631415</nova:name>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:11:04</nova:creationTime>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:user uuid="2554c8defe944528a06bbfd6f360dcd4">tempest-AttachVolumeShelveTestJSON-970754436-project-member</nova:user>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:project uuid="635951473383437bbabc3b1bb776416a">tempest-AttachVolumeShelveTestJSON-970754436</nova:project>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         <nova:port uuid="e5501dcb-7176-4b02-bf66-77b127e32767">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <system>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="serial">94b0397a-4725-422f-97f8-32d7b09d5c18</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="uuid">94b0397a-4725-422f-97f8-32d7b09d5c18</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </system>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <os>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </os>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <features>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </features>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   <devices>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:5d:c6:50"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <target dev="tape5501dcb-71"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </interface>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/console.log" append="off"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </serial>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <video>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </video>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </rng>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:   </devices>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]: </domain>
May 13 02:11:05.248686 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Preparing to wait for external event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoG38eRWKMTGsvpWosYiMin4smUcwcvBohNKwIWkgz90ZYwa4McR0N3k8G7cYX3YOxDixo3/iB71DluH6n0Nl7u031kYLRxzljgfyKObdoMrxQQ5w8sLr5p2ZFqhA3bvQ==',key_name='tempest-keypair-2087693019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:05.251230 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:11:05.252193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.252193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:05.252193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:11:05.253174 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.253174 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd112b7e-d600-5bf0-ad99-8c4efdc4c828', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:05.253747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.255394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:05.257139 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.257264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5501dcb-71, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:05.257511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5501dcb-71, col_values=(('qos', UUID('c9eaaee4-93a4-49c2-83c7-dabe9fa9f542')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:05.257665 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5501dcb-71, col_values=(('external_ids', {'iface-id': 'e5501dcb-7176-4b02-bf66-77b127e32767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:c6:50', 'vm-uuid': '94b0397a-4725-422f-97f8-32d7b09d5c18'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:05.258999 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.260027 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:05.267772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.269337 np0000000663 nova-compute[98103]: INFO os_vif [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71')
May 13 02:11:05.303979 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:05.385249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:05.386577 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:05.448182 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:05.565868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:05.647715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:05.888309 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:05.950138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:05.951140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:11:05.951700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:05.951938 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating image(s)
May 13 02:11:05.952295 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:11:05.953340 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:11:05.953494 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Ensure instance console log exists: /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:11:05.953683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:05.953851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:05.953990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:05.954406 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start _get_guest_xml network_info=[{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '6ba96da7-7f37-4f58-bb18-cc1196420d0c', 'attached_at': '', 'detached_at': '', 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'serial': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6'}, 'attachment_id': '8931c3ff-eb32-4f2d-8cc8-b4ca38106a26', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:11:05.958456 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:11:05.959271 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-636646220', uuid='6ba96da7-7f37-4f58-bb18-cc1196420d0c'), owner=OwnerMeta(userid='abcb4366c82d4e47ac0063497a857553', username='tempest-TestShelveInstance-2050500074-project-member', projectid='ed9f3615db854b36b4bf3041cc0f1bb3', projectname='tempest-TestShelveInstance-2050500074'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638265.9590156) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:11:05.962745 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:11:05.963865 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:11:05.964848 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:11:05.965295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:11:05.966273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:11:05.966540 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:11:05.966704 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:11:05.966759 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:11:05.966833 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:11:05.966913 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:11:05.966988 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:11:05.967148 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:11:05.967266 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:11:05.967364 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:11:05.967474 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:11:05.967590 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:11:05.967695 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:06.396271 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:11:06.396460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.706s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:06.396951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.750s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:06.397333 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:11:06.455869 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:06.469395 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Object Instance<6ba96da7-7f37-4f58-bb18-cc1196420d0c> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:06.485754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:06.487039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:06.487039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:06.487039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:06.487039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:06.503556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:06.504227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:06.505490 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:06.505490 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:06.505490 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:06.505690 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:06.520123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:06.520123 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:06.526678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:06.526678 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:06.534057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6] added
May 13 02:11:06.534057 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:06.534057 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:06.534057 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:06.534057 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:06.534057 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:06.534057 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:06.534371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:06.534577 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:06.534763 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6] added
May 13 02:11:06.542822 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:06.542822 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:06.542822 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:06.790167 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:06.790446 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:06.790492 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No VIF found with MAC fa:16:3e:5d:c6:50, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:06.791540 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Using config drive
May 13 02:11:06.914283 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:07.065656 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:07.066178 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:07.094101 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updated VIF entry in instance network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:11:07.094623 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:07.299931 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:07.418494 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating config drive at /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config
May 13 02:11:07.422123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zy_9o5j {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:07.484061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6zy_9o5j" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:07.535450 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:07.542908 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:07.548667 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:07.548667 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:07.557113 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:07.557113 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.566318 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.566864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.569549 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:07.578612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.578612 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.578612 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.578612 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.578612 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:07.578793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.578793 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.578793 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.578793 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.578793 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:07.584296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.584296 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.584296 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.584296 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.584296 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:07.584518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.584518 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.584518 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.584518 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.584518 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:07.598496 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d8ba461f-6b9f-43bd-99aa-d9eb1fc57cbe req-0ada2efb-8406-4159-b852-ab9cd4be19f5 service nova] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:07.617632 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260]
May 13 02:11:07.617632 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260] successful.
May 13 02:11:07.617632 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.624164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260]
May 13 02:11:07.624164 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260] successful.
May 13 02:11:07.624164 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.633865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.636808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.652849 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.653065 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:07.653368 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:07.653501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:07.654364 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] HCTL ('9', '-', '-', 0) found on session 95 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:07.654551 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.655699 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:07.655901 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:07.656109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:07.656223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:07.656883 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] HCTL ('10', '-', '-', 0) found on session 96 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:07.658333 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:07.673878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching for a device in session 95 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:07.673878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:07.683068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Searching for a device in session 96 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:07.683068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:07.986054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.023299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.025443 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.077350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.681s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:08.120680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.139781 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance 1fb86ac1-3a61-4254-83b6-b79416254ca5
May 13 02:11:08.209041 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-386023d1-6430-40c6-93c5-83ced0c0304a req-ddf083cd-0ac2-4422-b533-b1e77b492bc6 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:08.209396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-386023d1-6430-40c6-93c5-83ced0c0304a req-ddf083cd-0ac2-4422-b533-b1e77b492bc6 service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:08.212661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-386023d1-6430-40c6-93c5-83ced0c0304a req-ddf083cd-0ac2-4422-b533-b1e77b492bc6 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:08.213110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-386023d1-6430-40c6-93c5-83ced0c0304a req-ddf083cd-0ac2-4422-b533-b1e77b492bc6 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:08.213292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-386023d1-6430-40c6-93c5-83ced0c0304a req-ddf083cd-0ac2-4422-b533-b1e77b492bc6 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Processing event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:11:08.342559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.344884 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.347645 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.376536 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:08.505782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:11:08.901317 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638268.9007878, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:08.902292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:11:08.902541 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Started (Lifecycle Event)
May 13 02:11:08.909298 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:11:08.912183 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance spawned successfully.
May 13 02:11:08.912534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:11:09.153628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e499b273-6829-4f60-85df-a86211222f26 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "1fb86ac1-3a61-4254-83b6-b79416254ca5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.438s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:09.408124 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:09.410279 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.422150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:11:09.524966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Found WWN 33000000053051faa for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:09.525342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:09.525890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000053051faa', 'path': '/dev/dm-1', 'multipath_id': '33000000053051faa'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:09.525890 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053051faa', 'path': '/dev/dm-1', 'multipath_id': '33000000053051faa'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:09.912832 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:11:09.913129 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638269.9129052, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:09.913256 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Paused (Lifecycle Event)
May 13 02:11:09.929436 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Took 7.55 seconds to spawn the instance on the hypervisor.
May 13 02:11:09.930514 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:10.030868 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1178221670',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:56Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:11:10.031075 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:10.032037 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:10.032167 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:10.259837 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.268079 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:10.268387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:10.268667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:10.269260 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:10.270231 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:10.270553 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-34db2138-99e6-4a84-bde8-838b85db616b req-f674483e-e7a2-4b74-9685-9eda2aea67ce service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received unexpected event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with vm_state active and task_state None.
May 13 02:11:10.319783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:10.320048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:10.320544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:10.320752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:10.320909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:10.323922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Terminating instance
May 13 02:11:10.415268 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:10.417769 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638270.417586, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:10.417931 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Resumed (Lifecycle Event)
May 13 02:11:10.438840 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Took 16.36 seconds to build instance.
May 13 02:11:10.534038 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Object Instance<6ba96da7-7f37-4f58-bb18-cc1196420d0c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:10.535365 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] End _get_guest_xml xml=<domain type="qemu">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <uuid>6ba96da7-7f37-4f58-bb18-cc1196420d0c</uuid>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <name>instance-00000029</name>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestShelveInstance-server-636646220</nova:name>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:11:05</nova:creationTime>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:user uuid="abcb4366c82d4e47ac0063497a857553">tempest-TestShelveInstance-2050500074-project-member</nova:user>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:project uuid="ed9f3615db854b36b4bf3041cc0f1bb3">tempest-TestShelveInstance-2050500074</nova:project>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         <nova:port uuid="23c6fa8b-e040-4780-8aea-8f914748d497">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <system>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="serial">6ba96da7-7f37-4f58-bb18-cc1196420d0c</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="uuid">6ba96da7-7f37-4f58-bb18-cc1196420d0c</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </system>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <os>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </os>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <features>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </features>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   <devices>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <alias name="ua-efc2745e-bc3c-477d-a178-41ebcfb4c8f6"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <serial>efc2745e-bc3c-477d-a178-41ebcfb4c8f6</serial>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:dd:60:7e"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <target dev="tap23c6fa8b-e0"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </interface>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/console.log" append="off"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </serial>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <video>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </video>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </rng>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:   </devices>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]: </domain>
May 13 02:11:10.535365 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Preparing to wait for external event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1178221670',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:56Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:11:10.537263 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:10.537616 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.540866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dcbd4cf-4369-52fb-9415-1754bd4317a5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:10.541466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.545115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:10.545115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.548821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.548821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23c6fa8b-e0, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:10.548821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap23c6fa8b-e0, col_values=(('qos', UUID('9a7cd1eb-537a-49eb-96b0-faed228c93b8')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:10.548821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap23c6fa8b-e0, col_values=(('external_ids', {'iface-id': '23c6fa8b-e040-4780-8aea-8f914748d497', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:60:7e', 'vm-uuid': '6ba96da7-7f37-4f58-bb18-cc1196420d0c'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:10.548821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.552491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:10.555745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.556847 np0000000663 nova-compute[98103]: INFO os_vif [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0')
May 13 02:11:10.569467 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.827833 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:10.855131 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.860659 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.894796 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:10.920253 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:10.925115 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:11:10.939616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.876s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:11.015223 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.026551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.040375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:11.040776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:11.040776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:11.040942 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:11.041021 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:11.041212 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1200b77d-b49f-4911-a5f7-5981e9830945 req-baf2ab72-1356-4510-a376-45bc230b5b89 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:11.173607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.186344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.200142 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Instance destroyed successfully.
May 13 02:11:11.200679 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid 035777fc-feb7-4c85-97f5-322ea3fb60a7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:11.432398 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999719939999977 future=<Future at 0x705c6c1a2cf0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:11.460944 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:11.462022 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing instance network info cache due to event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:11:11.462285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:11.462414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:11.462584 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:11:11.703302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=30,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:08:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-tjz9stlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=035777fc-feb7-4c85-97f5-322ea3fb60a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:11.703531 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "a71035b8-9f4c-437d-b410-614dc6551a90", "address": "fa:16:3e:53:33:ed", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa71035b8-9f", "ovs_interfaceid": "a71035b8-9f4c-437d-b410-614dc6551a90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:11.704153 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:11.704450 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:11.706937 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.707308 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa71035b8-9f, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:11.708749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.709673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:11.714663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.716214 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.716468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1c46a75-702d-4124-95a7-d3026d5e9d59) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:11.717317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.717888 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:11.724785 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:11.726820 np0000000663 nova-compute[98103]: INFO os_vif [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:ed,bridge_name='br-int',has_traffic_filtering=True,id=a71035b8-9f4c-437d-b410-614dc6551a90,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa71035b8-9f')
May 13 02:11:11.727230 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Deleting instance files /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_del
May 13 02:11:11.737186 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Deletion of /opt/stack/data/nova/instances/035777fc-feb7-4c85-97f5-322ea3fb60a7_del complete
May 13 02:11:11.965172 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:12.078383 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:12.078383 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:12.078383 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] No VIF found with MAC fa:16:3e:dd:60:7e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:12.078383 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Using config drive
May 13 02:11:12.244452 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 02:11:12.245109 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:12.245387 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:12.245489 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:12.245690 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:12.315959 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:12.327087 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:12.473439 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updated VIF entry in instance network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:11:12.474447 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:12.580504 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'ec2_ids' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:12.976653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-909a4f19-bac1-4667-b489-ceb33380708a req-14b5b7a2-4cab-48ad-94ab-d1fd3b7af217 service nova] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:13.054618 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:13.086519 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Object Instance<6ba96da7-7f37-4f58-bb18-cc1196420d0c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:13.086717 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'keypairs' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] Acquiring lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] No waiting events found dispatching network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-unplugged-a71035b8-9f4c-437d-b410-614dc6551a90 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:13.121424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7e88932a-8cb8-42c6-b2a7-0ace8429f9cd req-b652665d-548e-4b57-8853-8c1289429e84 service nova] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Received event network-vif-deleted-a71035b8-9f4c-437d-b410-614dc6551a90 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:13.556719 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Took 1.31 seconds to deallocate network for instance.
May 13 02:11:13.589414 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Object Instance<6ba96da7-7f37-4f58-bb18-cc1196420d0c> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:13.594065 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:13.759140 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Creating config drive at /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config
May 13 02:11:13.762606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7rik0g6j {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:13.824343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7rik0g6j" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:14.069067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:14.069559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:14.281312 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:14.328496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:14.417792 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:14.498123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c25800b0-187c-4ae8-90e2-dbeb51fb89ec req-4f6a4764-ac8c-4765-8c57-1206df5d8ec0 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:14.500555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c25800b0-187c-4ae8-90e2-dbeb51fb89ec req-4f6a4764-ac8c-4765-8c57-1206df5d8ec0 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:14.500555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c25800b0-187c-4ae8-90e2-dbeb51fb89ec req-4f6a4764-ac8c-4765-8c57-1206df5d8ec0 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:14.500555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c25800b0-187c-4ae8-90e2-dbeb51fb89ec req-4f6a4764-ac8c-4765-8c57-1206df5d8ec0 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:14.500555 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c25800b0-187c-4ae8-90e2-dbeb51fb89ec req-4f6a4764-ac8c-4765-8c57-1206df5d8ec0 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Processing event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:11:14.652415 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:14.664851 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:14.664851 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:14.664851 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:14.691148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:15.164561 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:15.233263 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638275.2328532, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:15.233970 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:11:15.234205 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Started (Lifecycle Event)
May 13 02:11:15.237671 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:11:15.240837 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance spawned successfully.
May 13 02:11:15.241538 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:15.572737 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:15.672238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.603s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:15.688128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:15.731853 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance 035777fc-feb7-4c85-97f5-322ea3fb60a7
May 13 02:11:15.738264 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:15.744522 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:11:15.749736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4e2cb1fe-15db-427d-982f-15d60d64b167 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.866s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:16.249511 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638276.2491944, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:16.249718 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Paused (Lifecycle Event)
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:16.582234 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-171c6d3d-7ff3-4195-bfac-257601f4ba47 req-3e543b22-1209-4a2f-a743-76bf98c6eecf service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received unexpected event network-vif-plugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with vm_state active and task_state None.
May 13 02:11:16.717675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:16.741472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2d7a4a30-1803-4681-a807-aed94ba8dead tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "035777fc-feb7-4c85-97f5-322ea3fb60a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.421s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:16.752255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:16.755650 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638276.7553709, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:16.755787 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Resumed (Lifecycle Event)
May 13 02:11:17.260913 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:17.264439 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:11:17.626192 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00039398199987772387 future=<Future at 0x705c4876e330 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:17.626376 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:17.626376 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.805068604000098 future=<Future at 0x705c6c1a2cf0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:17.626477 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.804997031999847 future=<Future at 0x705c6c1a2cf0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:17.628990 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Emitting event <LifecycleEvent: 1778638262.6256387, 1fb86ac1-3a61-4254-83b6-b79416254ca5 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:17.628990 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] VM Stopped (Lifecycle Event)
May 13 02:11:18.130810 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 1fb86ac1-3a61-4254-83b6-b79416254ca5] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:18.798123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:18.798123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:18.798123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:18.798123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:18.798123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:18.799999 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Terminating instance
May 13 02:11:19.303781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:19.331608 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.334882 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.360953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.474590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.480728 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.530126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:19.530365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:19.530535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:19.530689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:19.530806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] No waiting events found dispatching network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:19.530920 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9e1cb25b-9fe2-4166-bee6-0f43f367494e req-2b36501c-119b-490a-8fb8-20344b6baf54 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:19.615984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.627577 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:19.649219 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999719207999988 future=<Future at 0x705c6c131400 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:19.656200 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Instance destroyed successfully.
May 13 02:11:19.656649 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid 49cb3e10-5cb6-4107-a854-b913e5ec46b1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:19.723057 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:19.726846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:20.159140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:06:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-1',id=25,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:22Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-gcl8q3m0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=49cb3e10-5cb6-4107-a854-b913e5ec46b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:20.159386 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "address": "fa:16:3e:83:8d:ae", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb6d0be5-c6", "ovs_interfaceid": "cb6d0be5-c6c1-46f7-9be7-cc1a008d8241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:20.160601 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:20.160872 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:20.162199 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:20.162445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb6d0be5-c6, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:20.163896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:20.164662 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:20.165111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:20.165890 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:20.166212 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9c066ec-0b74-400f-b914-589d0c6004ae) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:20.167539 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:20.169898 np0000000663 nova-compute[98103]: INFO os_vif [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8d:ae,bridge_name='br-int',has_traffic_filtering=True,id=cb6d0be5-c6c1-46f7-9be7-cc1a008d8241,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb6d0be5-c6')
May 13 02:11:20.170280 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Deleting instance files /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1_del
May 13 02:11:20.171108 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Deletion of /opt/stack/data/nova/instances/49cb3e10-5cb6-4107-a854-b913e5ec46b1_del complete
May 13 02:11:20.230858 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:20.427527 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:20.427923 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:20.573026 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:20.678848 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 02:11:20.679568 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:20.679972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:20.680227 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:20.680598 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:20.800977 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:20.932328 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:21.237368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:21.442130 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Ignoring supplied device name: /dev/vdb
May 13 02:11:21.579894 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:21.612337 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:21.613036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] Acquiring lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:21.613301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:21.613504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:21.613657 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] No waiting events found dispatching network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:21.613795 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-unplugged-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:21.613896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a82aec17-9fad-4c84-b4e4-1e503795153a req-1f71f3fb-2286-4d06-b9db-e43f073143a1 service nova] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Received event network-vif-deleted-cb6d0be5-c6c1-46f7-9be7-cc1a008d8241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:21.945070 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:22.082149 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Took 1.40 seconds to deallocate network for instance.
May 13 02:11:22.307484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:22.307659 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:22.307853 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attaching volume 771cd1ea-5e1d-430d-bfaa-570b0329fa47 to /dev/vdb
May 13 02:11:22.356892 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:22.368684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:11:22.393849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:22.450933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:11:22.451375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:11:22.462607 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:11:22.464045 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe8d:d0e5', 'fe80::449e:8fff:fea0:d122', 'fe80::fc16:3eff:fe0b:8579', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7'] 
May 13 02:11:22.464174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:11:22.464302 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:11:22.464535 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:22.467148 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating existing volume attachment record: 96ab0a2d-c8ad-4f79-a301-4ce2b1d53ae8 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:11:22.588338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:22.588555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:22.996863 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:22.997403 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:23.029046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:23.029129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:23.029355 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Attaching volume a37d9ddf-628d-44d2-a9a9-72f5698e2c1a to /dev/vdb
May 13 02:11:23.033479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:23.033479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:23.033479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:23.034020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:23.036118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:23.050362 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:23.051298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:23.052538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:23.052538 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:23.053056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:23.053291 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:23.070640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:23.070640 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:23.072676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:23.072676 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:23.085549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47] added
May 13 02:11:23.085549 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:23.085549 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:23.085549 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:23.085549 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:23.085549 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:23.085549 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:23.086474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:23.086771 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:23.087848 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:23.089337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47] added
May 13 02:11:23.089337 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:23.089337 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:23.089337 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:23.089337 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:23.089337 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:23.089337 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:23.089500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:23.089757 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:23.089936 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:23.098992 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:23.111202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:11:23.136686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:23.185805 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:11:23.186200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:11:23.195278 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:11:23.196758 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe71:1d0d', 'fe80::fc16:3eff:fe8d:d0e5', 'fe80::449e:8fff:fea0:d122', 'fe80::fc16:3eff:fe0b:8579', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7'] 
May 13 02:11:23.196957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:11:23.197129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:11:23.197451 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:23.197743 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating existing volume attachment record: 43ec5583-dbc4-40a8-9384-c62bfb347236 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:11:23.501025 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:23.757498 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:23.757903 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:23.758079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:24.013131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.424s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:24.070199 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance 49cb3e10-5cb6-4107-a854-b913e5ec46b1
May 13 02:11:24.088514 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:24.092343 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:24.102620 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:24.102620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:24.113193 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:24.113193 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.121485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.130704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.145285 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.145547 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.155350 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.155545 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:24.192275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.40.100,3260]
May 13 02:11:24.192275 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.40.100,3260] successful.
May 13 02:11:24.192275 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.207798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.215611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.50.100,3260]
May 13 02:11:24.215611 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.50.100,3260] successful.
May 13 02:11:24.215611 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.227140 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.227878 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:24.228612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:24.229886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:24.230141 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:24.231485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('13', '-', '-', 0) found on session 98 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:24.231628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:24.257026 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 98 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:24.257026 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.257420 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:24.257666 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:24.257957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:24.258154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:24.259002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('14', '-', '-', 0) found on session 99 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:24.259165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:24.276056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 99 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:24.276599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:25.054147 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:11:25.079853 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0caea702-fdb4-4bc1-aa0f-b8388db328e0 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "49cb3e10-5cb6-4107-a854-b913e5ec46b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.284s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:25.167732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:25.576149 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.070882 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found WWN 33000000068d605a9 for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:26.071328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:26.071510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000068d605a9', 'path': '/dev/dm-6', 'multipath_id': '33000000068d605a9'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:26.071696 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000068d605a9', 'path': '/dev/dm-6', 'multipath_id': '33000000068d605a9'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:26.072959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.315s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:26.073355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:26.076239 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:26.084849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:26.085484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:26.086124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:26.086365 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:26.086937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:26.087161 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:26.103131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:26.103131 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:26.110840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:26.110840 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:26.117781 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a] added
May 13 02:11:26.117781 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:26.117781 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:26.117781 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:26.117781 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:26.117781 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:26.117781 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:26.118155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:26.118419 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:26.118491 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:26.124939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a] added
May 13 02:11:26.124939 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:26.124939 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:26.124939 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:26.124939 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:26.124939 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:26.124939 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:26.125167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:26.125297 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0381(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:26.125449 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:26.194072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:26.194380 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:26.194651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:26.194860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:26.195022 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:26.197451 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Terminating instance
May 13 02:11:26.431951 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00041704100021888735 future=<Future at 0x705c6c1a2cf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:26.432115 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:26.432245 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.216400107000027 future=<Future at 0x705c6c131400 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:26.432333 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.216280504999759 future=<Future at 0x705c6c131400 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:26.433060 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Emitting event <LifecycleEvent: 1778638271.4314067, 035777fc-feb7-4c85-97f5-322ea3fb60a7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:26.433340 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] VM Stopped (Lifecycle Event)
May 13 02:11:26.579718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attempting to attach volume 771cd1ea-5e1d-430d-bfaa-570b0329fa47 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:11:26.581661 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:   <alias name="ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47"/>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:   <serial>771cd1ea-5e1d-430d-bfaa-570b0329fa47</serial>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:26.581661 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:11:26.700968 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:26.723820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.726616 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.759258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.864673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.870800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] No waiting events found dispatching network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:26.918581 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ec951e4a-9dd5-4b40-9e77-906251fa0fee req-4b43e611-9b8d-44f5-bc3e-b2e4094df0d8 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:26.937261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 035777fc-feb7-4c85-97f5-322ea3fb60a7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:27.011185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.017932 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.046744 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99911995499997 future=<Future at 0x705c881c69f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:27.054491 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Instance destroyed successfully.
May 13 02:11:27.058115 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid 2d1c8212-2a2a-4392-89cb-410a0a987de8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:27.118944 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:27.125960 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:27.136801 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:27.136801 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:27.147510 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:27.147510 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.159687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.167288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.183639 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.183900 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.190140 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:27.233549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.40.100,3260]
May 13 02:11:27.233549 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.40.100,3260] successful.
May 13 02:11:27.233549 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.240210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.50.100,3260]
May 13 02:11:27.240210 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.50.100,3260] successful.
May 13 02:11:27.240210 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.248435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.257805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.271161 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] HCTL ('15', '-', '-', 0) found on session 100 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:27.271161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.280722 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:27.281075 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:27.281429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:27.281429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:27.282607 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] HCTL ('16', '-', '-', 0) found on session 101 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:27.282755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:27.298377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 100 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:27.298451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:27.309739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 101 and hctl ['16', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:27.558419 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='multiattach-server-0',id=24,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwVY0kqsVQ2Av2pvxnddgHQiYfGTpT6qcPzHrlk8s1i0WvH00je8c3L6T2FCbOjaMkOPkhqq+M3Aol6LzTWqYaFMj0jpe0rQrZAhf45pd/nxx9Jv5J0xwaNznyscLFtcw==',key_name='tempest-keypair-1412322991',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:06:05Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-og5tdiab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=2d1c8212-2a2a-4392-89cb-410a0a987de8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:27.558709 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "4f211add-0e46-4ffd-a752-e55248d89c33", "address": "fa:16:3e:71:1d:0d", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f211add-0e", "ovs_interfaceid": "4f211add-0e46-4ffd-a752-e55248d89c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:27.561691 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:27.561691 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:27.561691 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.561691 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f211add-0e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75df76d6-ae7a-4208-ad04-4edade6cd4fa) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:27.566639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:27.571124 np0000000663 nova-compute[98103]: INFO os_vif [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:1d:0d,bridge_name='br-int',has_traffic_filtering=True,id=4f211add-0e46-4ffd-a752-e55248d89c33,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f211add-0e')
May 13 02:11:27.571124 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Deleting instance files /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8_del
May 13 02:11:27.571124 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Deletion of /opt/stack/data/nova/instances/2d1c8212-2a2a-4392-89cb-410a0a987de8_del complete
May 13 02:11:28.076389 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 02:11:28.076530 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:28.076714 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:28.076792 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:28.077010 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:28.190164 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:28.308726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 101 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:28.308863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:28.346674 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:28.346823 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:28.346947 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:28.347069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No VIF found with MAC fa:16:3e:8d:d0:e5, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:28.887875 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:28.977772 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:28.978010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] Acquiring lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:28.978104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:28.978272 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:28.978419 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] No waiting events found dispatching network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:28.978578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-unplugged-4f211add-0e46-4ffd-a752-e55248d89c33 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:28.978730 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5e94c6f4-1ab3-4a2e-9cc4-23536a1aee93 req-b4dad8ec-4722-496f-b0cb-40307ac077b6 service nova] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Received event network-vif-deleted-4f211add-0e46-4ffd-a752-e55248d89c33 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:29.101621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found WWN 33000000054120999 for multipath device dm-8 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:29.101838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:29.101981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== connect_volume: return (5344ms) {'type': 'block', 'scsi_wwn': '33000000054120999', 'path': '/dev/dm-8', 'multipath_id': '33000000054120999'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:29.102107 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000054120999', 'path': '/dev/dm-8', 'multipath_id': '33000000054120999'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:29.104566 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:29.390060 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Took 1.31 seconds to deallocate network for instance.
May 13 02:11:29.607585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Attempting to attach volume a37d9ddf-628d-44d2-a9a9-72f5698e2c1a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:11:29.610218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:   <alias name="ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a"/>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:   <serial>a37d9ddf-628d-44d2-a9a9-72f5698e2c1a</serial>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:29.610218 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:11:29.898581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:29.899981 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:29.901301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-81ffe083-4bcf-4000-8748-3e06c476a73d tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.593s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:30.312840 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:30.313017 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:30.580215 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:30.591410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:30.591564 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:30.815843 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:31.095850 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:31.279065 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:31.279214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:31.279214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:31.279313 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No VIF found with MAC fa:16:3e:0b:85:79, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:31.322691 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.423s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:31.380411 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance 2d1c8212-2a2a-4392-89cb-410a0a987de8
May 13 02:11:32.101773 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:32.391427 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3dd12e10-e0a3-47e4-9a68-1df481def5d5 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "2d1c8212-2a2a-4392-89cb-410a0a987de8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:32.566195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:32.837156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f3154859-1939-4c41-a8dd-a2d4c7afbc40 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.808s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:32.931128 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:32.931346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:33.205344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:33.205764 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:33.205764 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attaching volume 280c873c-d18b-47b9-baa6-3cfe61673898 to /dev/vdc
May 13 02:11:33.261653 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:33.275153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:11:33.297002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:33.339303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:11:33.340520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:11:33.349510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:11:33.352175 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe39:ba89', 'fe80::b4d7:55ff:fee2:d450', 'fe80::fc16:3eff:fe8d:d0e5', 'fe80::449e:8fff:fea0:d122', 'fe80::fc16:3eff:fe0b:8579', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7'] 
May 13 02:11:33.352175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:11:33.352175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:11:33.352175 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:33.352175 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating existing volume attachment record: de70426d-15e1-49c9-90a6-09d7ffdbe469 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:11:33.435766 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:33.917039 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:33.917415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:33.917532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:33.918140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:33.918188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:33.919628 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:33.919815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:33.919991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:33.920144 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:33.920271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:33.922749 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Terminating instance
May 13 02:11:33.933755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:33.934623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:33.936047 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:33.936320 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:33.937562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:33.937934 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:33.951178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:33.951178 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:33.954263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:33.954263 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:33.965191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898] added
May 13 02:11:33.965191 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:33.965191 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:33.965191 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:33.965191 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:33.965191 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:33.965191 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:33.965481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:33.965481 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0293(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:33.965628 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:33.971212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898] added
May 13 02:11:33.971212 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:33.971212 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:33.971212 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:33.971212 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:33.971212 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:33.971212 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:33.971388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:33.971449 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:33.971610 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:34.426366 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:34.441053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:34.451269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.484499 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.494726 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.525393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.526295 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] No waiting events found dispatching network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:34.633790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c5b66c7c-8bbb-4b07-b569-1987a6e0f3ad req-5185ffa2-4d60-4351-87a5-4452db003b65 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:34.649453 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0007574290002594353 future=<Future at 0x705c6c131400 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:34.649597 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:34.649701 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.396071668999866 future=<Future at 0x705c881c69f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:34.649802 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.395961753999927 future=<Future at 0x705c881c69f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:34.650450 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Emitting event <LifecycleEvent: 1778638279.6485584, 49cb3e10-5cb6-4107-a854-b913e5ec46b1 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:34.650696 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] VM Stopped (Lifecycle Event)
May 13 02:11:34.746175 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.757135 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:34.770013 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99965335600018 future=<Future at 0x705c6c2d9910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:34.773155 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Instance destroyed successfully.
May 13 02:11:34.773692 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lazy-loading 'resources' on Instance uuid cbbe0827-c00e-48cf-92c5-9246a81c635c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:34.966220 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:34.973153 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:34.985652 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:34.985652 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:34.995155 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:34.995155 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.009303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.018476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.031519 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.031889 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.046292 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.046654 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:35.095514 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.50.100,3260]
May 13 02:11:35.095514 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.50.100,3260] successful.
May 13 02:11:35.095514 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.102715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.40.100,3260]
May 13 02:11:35.102715 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.40.100,3260] successful.
May 13 02:11:35.102715 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.109937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.117086 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.133467 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.133804 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:35.134049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:35.134235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:35.135818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('18', '-', '-', 0) found on session 103 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:35.135962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.145793 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:35.146304 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:35.146304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:35.146651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:35.150968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] HCTL ('19', '-', '-', 0) found on session 104 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:35.150968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:35.150968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 103 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:35.150968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:35.153564 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 49cb3e10-5cb6-4107-a854-b913e5ec46b1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:35.166127 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Searching for a device in session 104 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:35.166127 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:35.279216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-2012050803',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumemultiattachtest-server-2012050803',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:05:45Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99c4c5b67d6749e98f7ab1203bb6201b',ramdisk_id='',reservation_id='r-2cdkoxr3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2055478852',owner_user_name='tempest-AttachVolumeMultiAttachTest-2055478852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:05:45Z,user_data=None,user_id='a1cbbca488aa421e8bb3c5cbacb6c4c8',uuid=cbbe0827-c00e-48cf-92c5-9246a81c635c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:35.279216 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converting VIF {"id": "479ffd65-f819-4082-90f2-c1ef692a37b5", "address": "fa:16:3e:39:ba:89", "network": {"id": "331e3c36-fc37-4210-b58a-af1d6e61ace1", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-190659702-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "99c4c5b67d6749e98f7ab1203bb6201b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap479ffd65-f8", "ovs_interfaceid": "479ffd65-f819-4082-90f2-c1ef692a37b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:35.279216 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:35.279851 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:35.281735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.282066 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap479ffd65-f8, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:35.284626 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.284626 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:35.285447 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.286491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.286491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f05c713-268a-40e7-aa1a-2b4251ee98dd) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:35.286936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.288582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:35.288582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.291779 np0000000663 nova-compute[98103]: INFO os_vif [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:ba:89,bridge_name='br-int',has_traffic_filtering=True,id=479ffd65-f819-4082-90f2-c1ef692a37b5,network=Network(331e3c36-fc37-4210-b58a-af1d6e61ace1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap479ffd65-f8')
May 13 02:11:35.336467 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:35.336467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:35.336467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:35.550374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:35.550841 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:35.550983 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attaching volume 6539d80f-a83e-4f0c-af1b-860b3f5498d1 to /dev/vdb
May 13 02:11:35.580047 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:35.606829 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:35.624274 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:11:35.648451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:35.701415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:11:35.703228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe8d:d0e5', 'fe80::449e:8fff:fea0:d122', 'fe80::fc16:3eff:fe0b:8579', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fedd:607e', 'fe80::29:82ff:feb6:fed7'] 
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:35.717986 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating existing volume attachment record: ac15eaec-fcc3-4dd9-962e-f6152e14fc50 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:11:35.937613 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:11:36.293600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:36.293994 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:36.294712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:36.693750 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:36.694516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] Acquiring lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:36.694516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:36.694686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:36.694813 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] No waiting events found dispatching network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:36.694909 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807c928c-a7a3-4f64-8370-b4ec98d1953b req-c47325ac-47b4-4ae6-b7fa-40c77c71e293 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-unplugged-479ffd65-f819-4082-90f2-c1ef692a37b5 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:36.951902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found WWN 33000000029481117 for multipath device dm-13 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:36.952319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:36.952489 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '33000000029481117', 'path': '/dev/dm-13', 'multipath_id': '33000000029481117'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:36.953980 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029481117', 'path': '/dev/dm-13', 'multipath_id': '33000000029481117'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:36.953980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.617s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:36.954180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01a2d499-a178-412c-9a0e-e14d16a76d29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:36.955518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:36.956958 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:36.991866 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:36.992666 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '99')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:36.992666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '33')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:36.993975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29', '34')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:36.995395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7098a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:36.995637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:36.995890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Flush multipath device 3300000003944c611 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:37.049409 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:37.101622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:37.151433 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:37.151611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:37.153693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:37.166520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:37.166743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:37.178775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.226537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.40.100,3260]
May 13 02:11:37.226537 np0000000663 nova-compute[98103]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.40.100,3260] successful.
May 13 02:11:37.226537 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.253572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.268795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.314182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.50.100,3260]
May 13 02:11:37.314182 np0000000663 nova-compute[98103]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-01a2d499-a178-412c-9a0e-e14d16a76d29, portal: 192.168.50.100,3260] successful.
May 13 02:11:37.314182 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] <== disconnect_volume: return (1998ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Deleting instance files /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c_del
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.042s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:37.338119 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Deletion of /opt/stack/data/nova/instances/cbbe0827-c00e-48cf-92c5-9246a81c635c_del complete
May 13 02:11:37.350521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:37.351179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:37.351730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:37.351937 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:37.355488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:37.355488 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:37.365912 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:37.365912 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.373231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:37.373231 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.390116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1] added
May 13 02:11:37.390116 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:37.390116 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:37.390116 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:37.390116 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:37.390116 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:37.390116 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.390388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:37.390503 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:37.390706 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:37.396416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1] added
May 13 02:11:37.396416 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:37.396416 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:37.396416 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:37.396416 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:37.396416 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:37.396416 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:37.396670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:37.396670 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:37.396823 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:37.459964 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attempting to attach volume 280c873c-d18b-47b9-baa6-3cfe61673898 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:11:37.463731 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:   <alias name="ua-280c873c-d18b-47b9-baa6-3cfe61673898"/>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-13"/>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:   <serial>280c873c-d18b-47b9-baa6-3cfe61673898</serial>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:37.463731 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:11:37.846151 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Took 3.42 seconds to destroy the instance on the hypervisor.
May 13 02:11:37.846548 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:37.846858 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:37.846981 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:37.847522 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:37.916340 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:38.232799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-24cd100d-8174-4da4-a3b1-321fbd7c8fdd req-d68b9c32-89c6-4f18-9f52-957287e03026 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Received event network-vif-deleted-479ffd65-f819-4082-90f2-c1ef692a37b5 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:38.232942 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-24cd100d-8174-4da4-a3b1-321fbd7c8fdd req-d68b9c32-89c6-4f18-9f52-957287e03026 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Neutron deleted interface 479ffd65-f819-4082-90f2-c1ef692a37b5; detaching it from the instance and deleting it from the info cache
May 13 02:11:38.233110 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-24cd100d-8174-4da4-a3b1-321fbd7c8fdd req-d68b9c32-89c6-4f18-9f52-957287e03026 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:38.391313 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:38.397538 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:38.408287 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:38.408287 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:38.416377 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:38.416377 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.424922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.430484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.445901 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.446441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.451424 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.451801 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:38.503648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260]
May 13 02:11:38.503648 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260] successful.
May 13 02:11:38.503648 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.515628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260]
May 13 02:11:38.515628 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260] successful.
May 13 02:11:38.515628 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.527728 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.534137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.549828 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.550719 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:38.550719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:38.552805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('11', '-', '-', 0) found on session 105 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:38.553008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:38.554154 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:38.554779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:38.554779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:38.557847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('12', '-', '-', 0) found on session 106 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:38.558102 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:38.584081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 106 and hctl ['12', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:38.584081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:38.584081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 105 and hctl ['11', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:38.584081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:38.674509 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:38.738264 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-24cd100d-8174-4da4-a3b1-321fbd7c8fdd req-d68b9c32-89c6-4f18-9f52-957287e03026 service nova] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Detach interface failed, port_id=479ffd65-f819-4082-90f2-c1ef692a37b5, reason: Instance cbbe0827-c00e-48cf-92c5-9246a81c635c could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:11:39.178088 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Took 1.33 seconds to deallocate network for instance.
May 13 02:11:39.182640 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:39.182778 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:39.182900 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:39.183017 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:39.183177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] No VIF found with MAC fa:16:3e:8d:d0:e5, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:39.354071 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:11:39.755328 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Took 0.58 seconds to detach 1 volumes for instance.
May 13 02:11:39.892964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:39.893251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:39.976951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:40.260917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:40.261370 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:40.287590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:40.370683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found WWN 330000000c5d702dd for multipath device dm-2 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:40.370942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:40.371117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== connect_volume: return (4077ms) {'type': 'block', 'scsi_wwn': '330000000c5d702dd', 'path': '/dev/dm-2', 'multipath_id': '330000000c5d702dd'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:40.371254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5d702dd', 'path': '/dev/dm-2', 'multipath_id': '330000000c5d702dd'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:40.376630 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:40.397472 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Detaching volume a37d9ddf-628d-44d2-a9a9-72f5698e2c1a
May 13 02:11:40.447538 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Attempting to driver detach volume a37d9ddf-628d-44d2-a9a9-72f5698e2c1a from mountpoint /dev/vdb
May 13 02:11:40.452862 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found disk vdb by alias ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:40.454583 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found disk vdb by alias ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:40.454736 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Attempting to detach device vdb from instance 7a8c1c60-c451-4350-8460-dd46e717314a from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:11:40.454906 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <alias name="ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a"/>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <serial>a37d9ddf-628d-44d2-a9a9-72f5698e2c1a</serial>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:40.454906 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:40.462351 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully detached device vdb from instance 7a8c1c60-c451-4350-8460-dd46e717314a from the persistent domain config.
May 13 02:11:40.462470 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] (1/8): Attempting to detach device vdb with device alias ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a from instance 7a8c1c60-c451-4350-8460-dd46e717314a from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:11:40.462753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <alias name="ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a"/>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-8"/>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <serial>a37d9ddf-628d-44d2-a9a9-72f5698e2c1a</serial>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:40.462753 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:40.582879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:40.672312 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:40.672593 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:40.743759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f07b0931-1291-4920-9433-dfe69994abb1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.538s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:40.879741 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attempting to attach volume 6539d80f-a83e-4f0c-af1b-860b3f5498d1 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:11:40.890718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:   <alias name="ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1"/>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-2"/>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:   <serial>6539d80f-a83e-4f0c-af1b-860b3f5498d1</serial>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:40.890718 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:11:41.175676 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:41.187476 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638301.1854076, 7a8c1c60-c451-4350-8460-dd46e717314a => ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:11:41.189329 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a for instance 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:11:41.193611 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully detached device vdb from instance 7a8c1c60-c451-4350-8460-dd46e717314a from the live domain config.
May 13 02:11:41.197622 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:41.198483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:41.198629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:41.199875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:41.200245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:41.201901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:41.260501 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [101] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:41.260899 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:41.260899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '99')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:41.262503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '100')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:41.263420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', '101')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:41.264638 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c4878f420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:41.264932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:41.265330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flush multipath device 33000000054120999 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:41.334943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:41.392200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:41.448861 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:41.449189 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:41.452213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:41.468174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:41.468477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:41.483310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.534324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.40.100,3260]
May 13 02:11:41.534324 np0000000663 nova-compute[98103]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.40.100,3260] successful.
May 13 02:11:41.534324 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.564390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.578998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.622209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 101, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.50.100,3260]
May 13 02:11:41.622209 np0000000663 nova-compute[98103]: Logout of [sid: 101, target: iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, portal: 192.168.50.100,3260] successful.
May 13 02:11:41.622209 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.642470 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:41.642765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:41.642943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== disconnect_volume: return (444ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:41.643172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:41.685313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.424s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:41.739122 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Deleted allocations for instance cbbe0827-c00e-48cf-92c5-9246a81c635c
May 13 02:11:42.046979 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0011676770000121905 future=<Future at 0x705c881c69f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:42.047084 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:42.047208 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.722387923000042 future=<Future at 0x705c6c2d9910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:42.047291 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=7.722309416999906 future=<Future at 0x705c6c2d9910 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:42.048738 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638287.0457075, 2d1c8212-2a2a-4392-89cb-410a0a987de8 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:42.048738 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] VM Stopped (Lifecycle Event)
May 13 02:11:42.222367 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:42.553139 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 2d1c8212-2a2a-4392-89cb-410a0a987de8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:42.597410 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:42.597662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:42.597756 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:11:42.598157 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:77:23:1c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:11:42.755861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6b9cd434-d7e8-4156-81d4-ced7ed0d9b13 tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Lock "cbbe0827-c00e-48cf-92c5-9246a81c635c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.836s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:43.230677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d0092ea3-2a9c-4bd5-a74a-014717b6bac8 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.337s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:43.233466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.254s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:43.233804 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:43.234155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:43.234417 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:43.236716 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Terminating instance
May 13 02:11:43.742648 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:43.769088 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:43.773087 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:43.798842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:43.802722 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:43.839615 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:43.959592 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:43.959961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:43.960104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:43.960264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:43.961429 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] No waiting events found dispatching network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:43.961429 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7cdcccb1-1057-4b2d-a8b0-7cee08b42b60 req-fdc28b5a-e218-4350-af9c-1748a93e84a8 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:44.108807 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999768250000216 future=<Future at 0x705c88204c20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:44.110715 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Instance destroyed successfully.
May 13 02:11:44.111168 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'resources' on Instance uuid 7a8c1c60-c451-4350-8460-dd46e717314a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:44.180622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7500c1d5-c5ef-4c8d-9b2f-814f39e75537 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.630s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:44.519452 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:44.519637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:44.519763 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:44.523467 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98103) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 02:11:44.523929 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:44.613462 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1721294325',display_name='tempest-VolumesSnapshotTestJSON-instance-1721294325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-1721294325',id=44,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqIiL9UyJ2RBSVaL84a/Sd8T1Ua2++QdyarU1MCyHUrM8+3s/kIBLxI3CUDH81eNgWyjC0opLMsEBHnoUMzXjBfowrJsT1tk8R3mXbaTbH40Qta7YL8qpmK/kwxXoSs1Q==',key_name='tempest-keypair-1070579376',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:42Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-cwh23n2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=7a8c1c60-c451-4350-8460-dd46e717314a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:44.613682 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "address": "fa:16:3e:0b:85:79", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb581ae8-65", "ovs_interfaceid": "cb581ae8-654d-4b1e-bb9e-d908d2effedf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:44.614323 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:44.614550 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:44.616700 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:44.616700 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb581ae8-65, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:44.618506 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:44.618506 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:44.619389 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:44.619389 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=652821f9-8975-4e78-9023-dccc3653293a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:44.620541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:44.620541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:44.622041 np0000000663 nova-compute[98103]: INFO os_vif [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:85:79,bridge_name='br-int',has_traffic_filtering=True,id=cb581ae8-654d-4b1e-bb9e-d908d2effedf,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb581ae8-65')
May 13 02:11:44.623562 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:44.623836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:44.623943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:44.624265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:44.624512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:44.624620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:44.669578 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-feb9bf78-d90e-4164-948f-e9f29627fd60', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '99')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a37d9ddf-628d-44d2-a9a9-72f5698e2c1a') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:11:44.669578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c6480>, {}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:44.670730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Disconnecting from: [] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:44.670730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:44.670730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== disconnect_volume: return (46ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:44.670730 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:44.670730 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Deleting instance files /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a_del
May 13 02:11:44.671885 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Deletion of /opt/stack/data/nova/instances/7a8c1c60-c451-4350-8460-dd46e717314a_del complete
May 13 02:11:45.181561 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 02:11:45.182068 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:45.182279 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:45.182378 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:45.182603 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:45.315597 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:45.553428 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.559682 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.588241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.588520 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.611595 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.615585 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:45.844610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2c90874b-6db3-4457-81e3-f1fb38e28cf4 req-a8450ef6-a441-41fe-8550-bd8adb5f5d69 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-deleted-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:45.845440 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-2c90874b-6db3-4457-81e3-f1fb38e28cf4 req-a8450ef6-a441-41fe-8550-bd8adb5f5d69 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Neutron deleted interface cb581ae8-654d-4b1e-bb9e-d908d2effedf; detaching it from the instance and deleting it from the info cache
May 13 02:11:45.845525 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2c90874b-6db3-4457-81e3-f1fb38e28cf4 req-a8450ef6-a441-41fe-8550-bd8adb5f5d69 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:45.873454 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999491544999728 future=<Future at 0x705c4872ddc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:45.876170 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance destroyed successfully.
May 13 02:11:45.876639 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:46.071183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:46.071851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Acquiring lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:46.072136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:46.072379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Lock "7a8c1c60-c451-4350-8460-dd46e717314a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:46.072707 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] No waiting events found dispatching network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:46.072903 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Received event network-vif-unplugged-cb581ae8-654d-4b1e-bb9e-d908d2effedf for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:46.073101 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:46.073300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:46.073504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:46.073725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:46.073859 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:46.074053 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ca80ac98-3d62-43cf-abce-5327a7fdd14e req-1b8cd757-bec4-4e36-b7d5-5dc54810a092 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state active and task_state powering-off.
May 13 02:11:46.129140 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:46.297201 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:46.349200 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2c90874b-6db3-4457-81e3-f1fb38e28cf4 req-a8450ef6-a441-41fe-8550-bd8adb5f5d69 service nova] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Detach interface failed, port_id=cb581ae8-654d-4b1e-bb9e-d908d2effedf, reason: Instance 7a8c1c60-c451-4350-8460-dd46e717314a could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:11:46.383285 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:46.383630 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:46.671850 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:46.672176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:46.799223 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Took 1.62 seconds to deallocate network for instance.
May 13 02:11:46.819436 np0000000663 nova-compute[98103]: WARNING nova.volume.cinder [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Attachment 43ec5583-dbc4-40a8-9384-c62bfb347236 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 43ec5583-dbc4-40a8-9384-c62bfb347236. (HTTP 404) (Request-ID: req-73a0c280-a346-4dde-95fe-a4dd355f1398)
May 13 02:11:46.819743 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Took 0.02 seconds to detach 1 volumes for instance.
May 13 02:11:46.890701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6506ea89-3ec7-423f-9603-fa2353d88737 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.371s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:47.177561 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Detaching volume 771cd1ea-5e1d-430d-bfaa-570b0329fa47
May 13 02:11:47.220757 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attempting to driver detach volume 771cd1ea-5e1d-430d-bfaa-570b0329fa47 from mountpoint /dev/vdb
May 13 02:11:47.225498 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found disk vdb by alias ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:47.226962 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found disk vdb by alias ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:47.227126 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Attempting to detach device vdb from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:11:47.227364 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <alias name="ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47"/>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <serial>771cd1ea-5e1d-430d-bfaa-570b0329fa47</serial>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:47.227364 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:47.233326 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully detached device vdb from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the persistent domain config.
May 13 02:11:47.233471 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] (1/8): Attempting to detach device vdb with device alias ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47 from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:11:47.233714 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <alias name="ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47"/>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-6"/>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <serial>771cd1ea-5e1d-430d-bfaa-570b0329fa47</serial>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:47.233714 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:47.317073 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:47.326407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:47.326544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:47.653080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:11:47.653285 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:11:47.779037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638307.7787092, 35a03c2e-e053-46e6-bb2e-5668f555c78e => ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:11:47.780378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-771cd1ea-5e1d-430d-bfaa-570b0329fa47 for instance 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:11:47.783836 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully detached device vdb from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the live domain config.
May 13 02:11:47.786528 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:47.786879 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:47.787155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:47.787533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:47.788220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '771cd1ea-5e1d-430d-bfaa-570b0329fa47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:47.788220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:47.818062 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [98] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47 (non-flash)
May 13 02:11:47.818626 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '99')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:47.818626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '98')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:47.821477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47', '99')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:47.822463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c699da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:47.822669 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:47.822923 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Flush multipath device 33000000068d605a9 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:47.824079 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:47.824264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquired lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:47.824412 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:11:47.824569 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'info_cache' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:47.859935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:47.912601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:47.952110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:47.952335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:47.953623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:47.964324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:47.964507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:47.976113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.008438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.40.100,3260]
May 13 02:11:48.008438 np0000000663 nova-compute[98103]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.40.100,3260] successful.
May 13 02:11:48.008438 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.030330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.043188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.083551 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.50.100,3260]
May 13 02:11:48.083551 np0000000663 nova-compute[98103]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-771cd1ea-5e1d-430d-bfaa-570b0329fa47, portal: 192.168.50.100,3260] successful.
May 13 02:11:48.083551 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.102755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:48.102755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:48.102954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== disconnect_volume: return (316ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:48.103117 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:48.138315 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:48.138421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:48.138603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:48.138792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:48.139008 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:48.139455 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-19be2770-5d37-4285-9045-46fd74cb0f40 req-908a4aed-194e-41ce-a587-036c9781c0c4 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:11:48.155556 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:11:48.327162 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:48.649872 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:48.662725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.336s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:48.709703 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Deleted allocations for instance 7a8c1c60-c451-4350-8460-dd46e717314a
May 13 02:11:48.829228 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:49.155279 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:49.280041 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:49.621741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:49.658632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1bf8bd32-7829-41b2-a803-f8a5b284b6f1 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.986s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:49.721241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8cc56d6f-98d4-48eb-9050-2d307ccb9dea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "7a8c1c60-c451-4350-8460-dd46e717314a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.490s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:49.770622 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0009616209999876446 future=<Future at 0x705c6c2d9910 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:49.771991 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Emitting event <LifecycleEvent: 1778638294.7695358, cbbe0827-c00e-48cf-92c5-9246a81c635c => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:49.772377 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:49.772668 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] VM Stopped (Lifecycle Event)
May 13 02:11:49.772902 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.335657602000083 future=<Future at 0x705c88204c20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:49.773082 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.335471907000283 future=<Future at 0x705c88204c20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:49.782437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Releasing lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:50.276634 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5e81dd07-d357-4481-aec2-d630af9b3266 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: cbbe0827-c00e-48cf-92c5-9246a81c635c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:50.306351 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:50.306573 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:50.306771 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Shelving
May 13 02:11:50.630863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:50.796415 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance destroyed successfully.
May 13 02:11:50.798192 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:51.298740 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:51.299101 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'resources' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:51.338869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.342267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.365122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.378334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.399018 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.407928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.507759 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:51.507759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:51.507759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:51.507991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:51.507991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:51.508215 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3025b666-514c-447e-8e9d-eecd2e36e2f9 req-78434ac0-5165-4b08-ae69-7421b0ba4da4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received unexpected event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with vm_state active and task_state shelving.
May 13 02:11:51.651564 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999717324999892 future=<Future at 0x705c6c146360 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:51.653110 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance destroyed successfully.
May 13 02:11:51.653789 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'numa_topology' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:51.801036 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:51.804022 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:51.804022 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:51.804022 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:51.804022 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:51.805193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.805193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c5c508-74, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:51.806607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.807514 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:51.812596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.813864 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.814217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a03d970-ca9c-4450-9c80-f26bfc91286c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:51.814847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.815915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:51.820679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:51.823387 np0000000663 nova-compute[98103]: INFO os_vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:11:51.830152 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:51.830508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:51.830691 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:51.831110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:51.831451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:51.831626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:51.868712 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:51.869208 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:51.869208 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '106'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:51.869581 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '106')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:51.872623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '105')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:51.874060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c70afc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:51.874285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:51.874600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flush multipath device 330000000c5d702dd {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:51.915651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:51.973028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:52.026789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:52.027003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:52.028696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:52.042381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:52.042657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:52.055572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.095005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260]
May 13 02:11:52.095005 np0000000663 nova-compute[98103]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260] successful.
May 13 02:11:52.095005 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.116453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.134717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.175108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260]
May 13 02:11:52.175108 np0000000663 nova-compute[98103]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260] successful.
May 13 02:11:52.175108 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.192720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.193134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:52.193319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== disconnect_volume: return (362ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:52.193445 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:52.200776 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start _get_guest_xml network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': '0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9', 'attached_at': '', 'detached_at': '', 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'serial': '6539d80f-a83e-4f0c-af1b-860b3f5498d1'}, 'attachment_id': 'ac15eaec-fcc3-4dd9-962e-f6152e14fc50', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:11:52.207557 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:11:52.209072 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-101663398', uuid='0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'), owner=OwnerMeta(userid='3b3cc512843b427fa59414fdf92f5e76', username='tempest-AttachVolumeTestJSON-1185409082-project-member', projectid='c97b10a192fd43f689e55b4537a4f824', projectname='tempest-AttachVolumeTestJSON-1185409082'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638312.2086349) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:11:52.211158 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:11:52.211538 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:11:52.213046 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:11:52.213310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:11:52.214732 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:11:52.215106 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:11:52.215787 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:11:52.216003 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:11:52.216213 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:11:52.216343 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:11:52.218037 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:11:52.218725 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:11:52.218947 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:11:52.219253 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:11:52.219735 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:11:52.219735 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:11:52.220814 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:52.268783 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Beginning cold snapshot process
May 13 02:11:52.723375 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:52.737206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:52.852472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:52.854083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:52.854358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:52.855038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:52.855534 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:11:52.859954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:52.860405 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:52.860848 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:52.861165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:11:52.875605 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:52.879838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:52.881078 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:52.881531 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:52.882068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:52.882325 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:52.895892 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:52.895892 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.901785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:11:52.901785 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.908772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1] added
May 13 02:11:52.908772 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:52.908772 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:52.908772 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:52.908772 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:52.908772 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:52.908772 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.909032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:52.909403 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:52.909587 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:52.915043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1] added
May 13 02:11:52.915043 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:11:52.915043 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:52.915043 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:52.915043 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:11:52.915043 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:11:52.915043 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:52.915404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:11:52.915463 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0331(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:11:52.915638 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:11:53.592837 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:53.593425 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:53.593512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:53.593704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:53.593952 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:53.593952 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-db77e20a-35be-40d2-9a05-cc2860293570 req-1f90573a-4374-4b95-a391-bf0ba9a185c4 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received unexpected event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with vm_state active and task_state shelving_image_pending_upload.
May 13 02:11:53.787858 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:11:53.788276 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk /opt/stack/data/nova/instances/snapshots/tmpn0ahf5i4/dc6e58d609004853af9532c515762b79 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:53.910997 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:11:53.916300 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:53.932771 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:53.932771 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:11:53.935804 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:11:53.935804 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:53.943863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:53.951264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.960930 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.961378 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:53.974407 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:54.015935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260]
May 13 02:11:54.015935 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260] successful.
May 13 02:11:54.015935 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:54.022495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260]
May 13 02:11:54.022495 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260] successful.
May 13 02:11:54.022495 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:54.029527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:54.039534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.050261 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.050629 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:54.050894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:54.050894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:54.052449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('11', '-', '-', 0) found on session 108 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:54.052686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:54.056947 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk /opt/stack/data/nova/instances/snapshots/tmpn0ahf5i4/dc6e58d609004853af9532c515762b79" returned: 0 in 0.269s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:54.057343 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Snapshot extracted, beginning image upload
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.061211 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:54.062390 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:54.062390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:11:54.063400 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('12', '-', '-', 0) found on session 109 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:11:54.063575 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:11:54.073173 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 108 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:54.073173 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:54.079757 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:54.080502 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing instance network info cache due to event network-changed-23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:11:54.080870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] Acquiring lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:54.081017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] Acquired lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:54.081208 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Refreshing network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:11:54.088859 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 109 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:11:54.089085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:11:54.586123 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:54.617059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:54.617305 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:54.617551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:54.617680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:54.617832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:54.620540 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Terminating instance
May 13 02:11:54.816930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:54.816930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:54.882844 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:11:54.956399 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:55.113621 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updated VIF entry in instance network info cache for port 23c6fa8b-e040-4780-8aea-8f914748d497. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:11:55.113893 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [{"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:55.126315 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:11:55.154131 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.157897 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.189255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.191054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.215605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.226178 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.317342 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:55.317559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:55.318284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:55.318284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:55.318354 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:55.319659 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab5a3458-2107-43ea-a8f7-f5fd9ac58546 req-f87ad245-fbd5-4bc1-acb3-b491fe6b9831 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:55.321366 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Detaching volume 280c873c-d18b-47b9-baa6-3cfe61673898
May 13 02:11:55.367588 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Attempting to driver detach volume 280c873c-d18b-47b9-baa6-3cfe61673898 from mountpoint /dev/vdc
May 13 02:11:55.374463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found disk vdc by alias ua-280c873c-d18b-47b9-baa6-3cfe61673898 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:55.375718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Found disk vdc by alias ua-280c873c-d18b-47b9-baa6-3cfe61673898 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:11:55.375868 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Attempting to detach device vdc from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:11:55.376196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <alias name="ua-280c873c-d18b-47b9-baa6-3cfe61673898"/>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-13"/>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <serial>280c873c-d18b-47b9-baa6-3cfe61673898</serial>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:55.376196 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:55.390196 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully detached device vdc from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the persistent domain config.
May 13 02:11:55.390362 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] (1/8): Attempting to detach device vdc with device alias ua-280c873c-d18b-47b9-baa6-3cfe61673898 from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:11:55.390636 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <alias name="ua-280c873c-d18b-47b9-baa6-3cfe61673898"/>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-13"/>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <serial>280c873c-d18b-47b9-baa6-3cfe61673898</serial>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]: </disk>
May 13 02:11:55.390636 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:11:55.449597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.463425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.465872 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.9996571329998 future=<Future at 0x705c6c7117f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:55.476023 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Instance destroyed successfully.
May 13 02:11:55.476023 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lazy-loading 'resources' on Instance uuid 6ba96da7-7f37-4f58-bb18-cc1196420d0c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:55.615714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f34bcb36-e7e0-4b2a-b6d8-919cb9f3e5f6 req-7670f44d-cf8c-4a07-878c-5346a58c354c service nova] Releasing lock "refresh_cache-6ba96da7-7f37-4f58-bb18-cc1196420d0c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:55.631951 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.903728 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found WWN 330000000c5d702dd for multipath device dm-2 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:11:55.904406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:55.904672 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000c5d702dd', 'path': '/dev/dm-2', 'multipath_id': '330000000c5d702dd'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:55.904880 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c5d702dd', 'path': '/dev/dm-2', 'multipath_id': '330000000c5d702dd'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:11:55.978120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:09:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-636646220',display_name='tempest-TestShelveInstance-server-636646220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testshelveinstance-server-636646220',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNHjRx8Ie8JjdF7ibpIk1pSDVp6aIBHI4BtA+dmDB063keYC9/wUS5YBOeJj3qqSu5AO1rTcliDXP7qi+k6voVjl7VkbCp1kCgtVu8f0XDcRNKhun58Mdf+xQ3pYvF5ow==',key_name='tempest-TestShelveInstance-1178221670',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:11:15Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed9f3615db854b36b4bf3041cc0f1bb3',ramdisk_id='',reservation_id='r-y02ug0yi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2050500074',owner_user_name='tempest-TestShelveInstance-2050500074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:11:15Z,user_data=None,user_id='abcb4366c82d4e47ac0063497a857553',uuid=6ba96da7-7f37-4f58-bb18-cc1196420d0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:11:55.978343 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converting VIF {"id": "23c6fa8b-e040-4780-8aea-8f914748d497", "address": "fa:16:3e:dd:60:7e", "network": {"id": "70b1a88d-4f55-442b-bde8-8c3abc713aa6", "bridge": "br-int", "label": "tempest-TestShelveInstance-1649881901-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed9f3615db854b36b4bf3041cc0f1bb3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap23c6fa8b-e0", "ovs_interfaceid": "23c6fa8b-e040-4780-8aea-8f914748d497", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:55.979036 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:55.979296 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:11:55.980805 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.981175 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23c6fa8b-e0, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:55.984299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.984929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:55.989041 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.991473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.991800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a7cd1eb-537a-49eb-96b0-faed228c93b8) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:55.992551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:55.996122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:55.999288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:56.002460 np0000000663 nova-compute[98103]: INFO os_vif [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:60:7e,bridge_name='br-int',has_traffic_filtering=True,id=23c6fa8b-e040-4780-8aea-8f914748d497,network=Network(70b1a88d-4f55-442b-bde8-8c3abc713aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23c6fa8b-e0')
May 13 02:11:56.007103 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:56.007530 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:56.007731 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:56.008154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:56.008564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:56.008743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:56.051104 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6 (non-flash)
May 13 02:11:56.051353 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:56.051628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:56.051751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '95')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:56.054716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6', '96')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:56.054716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48655440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:56.055173 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:56.055356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Flush multipath device 33000000053051faa {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:56.076913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638316.0765805, 35a03c2e-e053-46e6-bb2e-5668f555c78e => ua-280c873c-d18b-47b9-baa6-3cfe61673898> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:11:56.081345 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-280c873c-d18b-47b9-baa6-3cfe61673898 for instance 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:11:56.090988 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully detached device vdc from instance 35a03c2e-e053-46e6-bb2e-5668f555c78e from the live domain config.
May 13 02:11:56.094343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:11:56.094343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:11:56.094343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:11:56.117123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:56.162663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:56.220831 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:56.221039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:56.222419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:56.236376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:56.236469 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:56.249830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.286828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260]
May 13 02:11:56.286828 np0000000663 nova-compute[98103]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.40.100,3260] successful.
May 13 02:11:56.286828 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.308894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.320599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.363383 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260]
May 13 02:11:56.363383 np0000000663 nova-compute[98103]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-efc2745e-bc3c-477d-a178-41ebcfb4c8f6, portal: 192.168.50.100,3260] successful.
May 13 02:11:56.363383 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.386532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.386762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:56.386930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] <== disconnect_volume: return (379ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:56.387009 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:56.387336 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deleting instance files /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c_del
May 13 02:11:56.387768 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deletion of /opt/stack/data/nova/instances/6ba96da7-7f37-4f58-bb18-cc1196420d0c_del complete
May 13 02:11:56.389723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.295s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:11:56.389723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '280c873c-d18b-47b9-baa6-3cfe61673898', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:11:56.390013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:11:56.413667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:11:56.413945 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:56.418040 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:56.420192 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.427776 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [107] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:11:56.430290 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-31a29280-db25-4709-acef-ce37b203e088', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:11:56.430290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '104')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:56.435188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898', '103')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:11:56.436264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7da2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:11:56.438187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Removing multipathed devices sdn, sdm {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:11:56.438473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Flush multipath device 33000000029481117 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:11:56.477274 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:56.521623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:11:56.569241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:11:56.570595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:11:56.573306 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:11:56.597326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:11:56.597326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:11:56.615198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.652626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.40.100,3260]
May 13 02:11:56.652626 np0000000663 nova-compute[98103]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.40.100,3260] successful.
May 13 02:11:56.652626 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.668798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.683013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.725260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.50.100,3260]
May 13 02:11:56.725260 np0000000663 nova-compute[98103]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-280c873c-d18b-47b9-baa6-3cfe61673898, portal: 192.168.50.100,3260] successful.
May 13 02:11:56.725260 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.747349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:11:56.747555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:11:56.747659 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== disconnect_volume: return (653ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:11:56.747781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:11:56.902770 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Took 1.78 seconds to destroy the instance on the hypervisor.
May 13 02:11:56.903457 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:11:56.903813 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:11:56.903813 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:11:56.904464 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:56.922255 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:56.924325 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] End _get_guest_xml xml=<domain type="qemu">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <uuid>0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</uuid>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <name>instance-0000002d</name>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeTestJSON-server-101663398</nova:name>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:11:52</nova:creationTime>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:user uuid="3b3cc512843b427fa59414fdf92f5e76">tempest-AttachVolumeTestJSON-1185409082-project-member</nova:user>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:project uuid="c97b10a192fd43f689e55b4537a4f824">tempest-AttachVolumeTestJSON-1185409082</nova:project>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         <nova:port uuid="28c5c508-74e7-4622-8bbe-b35276f1e65c">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <system>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="serial">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="uuid">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </system>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <os>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </os>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <features>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </features>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   <devices>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <alias name="ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-2"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <serial>6539d80f-a83e-4f0c-af1b-860b3f5498d1</serial>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </disk>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:77:23:1c"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <target dev="tap28c5c508-74"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </interface>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/console.log" append="off"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </serial>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <video>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </video>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </rng>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:   </devices>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]: </domain>
May 13 02:11:56.924325 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:11:56.929695 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:57.008435 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:57.039973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:57.040547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:57.158557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:57.158976 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:11:57.159623 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:57.176156 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Snapshot image upload complete
May 13 02:11:57.176509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:57.335857 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'flavor' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:57.388909 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:57.390180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] Acquiring lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:57.390451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:57.390878 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:57.390878 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] No waiting events found dispatching network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:57.390982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-442d3eb0-d320-46ac-ac36-0f64a1a7d316 req-215e0983-5c43-455e-bf63-1eef9796f5d1 service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-unplugged-23c6fa8b-e040-4780-8aea-8f914748d497 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:11:57.420937 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-52c59a0e-6194-491a-9f2c-88398fb72106 req-e95d5dbc-db17-4d14-a2cc-428ba14cd94b service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Received event network-vif-deleted-23c6fa8b-e040-4780-8aea-8f914748d497 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:57.421359 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-52c59a0e-6194-491a-9f2c-88398fb72106 req-e95d5dbc-db17-4d14-a2cc-428ba14cd94b service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Neutron deleted interface 23c6fa8b-e040-4780-8aea-8f914748d497; detaching it from the instance and deleting it from the info cache
May 13 02:11:57.421646 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-52c59a0e-6194-491a-9f2c-88398fb72106 req-e95d5dbc-db17-4d14-a2cc-428ba14cd94b service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:57.670925 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:57.671615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:57.707071 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Shelve offloading
May 13 02:11:57.807742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.136s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:57.808194 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:11:57.808433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:11:57.846760 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:57.926971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-52c59a0e-6194-491a-9f2c-88398fb72106 req-e95d5dbc-db17-4d14-a2cc-428ba14cd94b service nova] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Detach interface failed, port_id=23c6fa8b-e040-4780-8aea-8f914748d497, reason: Instance 6ba96da7-7f37-4f58-bb18-cc1196420d0c could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:11:57.935406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:11:57.936211 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:11:57.936371 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:11:58.218131 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance destroyed successfully.
May 13 02:11:58.218780 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:58.221281 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:58.221491 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:58.221718 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:11:58.281780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:58.282106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:58.351263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-99ea39fa-df6f-42e6-8992-747510cf7988 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.535s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:58.352023 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Took 1.45 seconds to deallocate network for instance.
May 13 02:11:58.438906 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:11:58.440473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:11:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:11:58.440774 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:11:58.441815 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:11:58.442221 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:11:58.442647 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.443058 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:58.443442 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:11:58.444266 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.444468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0d0df4c-23da-5f98-be2f-42d81ff94be5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:58.445366 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.446361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:58.451583 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.453684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.453895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c5c508-74, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:58.454189 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28c5c508-74, col_values=(('qos', UUID('b98050d5-952e-47b4-a7ab-6643ecbc6548')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:58.454333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28c5c508-74, col_values=(('external_ids', {'iface-id': '28c5c508-74e7-4622-8bbe-b35276f1e65c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:23:1c', 'vm-uuid': '0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:11:58.455229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.456435 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:11:58.467654 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:58.468597 np0000000663 nova-compute[98103]: INFO os_vif [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:11:58.724267 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:58.788409 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:11:58.921938 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Took 0.57 seconds to detach 1 volumes for instance.
May 13 02:11:58.924329 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Deleting volume: efc2745e-bc3c-477d-a178-41ebcfb4c8f6 {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:11:58.968745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.007685 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.109582 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0009908259999065194 future=<Future at 0x705c88204c20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:59.109732 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:59.109861 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.7630090409998047 future=<Future at 0x705c4872ddc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:59.109984 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.7628929949996746 future=<Future at 0x705c4872ddc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:11:59.110816 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Emitting event <LifecycleEvent: 1778638304.1084802, 7a8c1c60-c451-4350-8460-dd46e717314a => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:11:59.111171 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] VM Stopped (Lifecycle Event)
May 13 02:11:59.134905 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.217287 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:59.266705 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:59.268056 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:59.271646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:59.271861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:11:59.272067 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:11:59.272421 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8f822f3e-50a7-408b-8218-9efbf1d8e52b req-d35b1dc8-3210-41eb-9f42-6baeecf37450 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:11:59.372670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:59.372670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:11:59.376444 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:11:59.377385 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Claim successful on node np0000000663
May 13 02:11:59.415267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.425776 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.430776 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.463044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.473258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:11:59.477593 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:11:59.615311 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-10791b6a-59ef-478b-ab9d-f3906dfb8c2a tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 7a8c1c60-c451-4350-8460-dd46e717314a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:11:59.651607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-changed-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:11:59.651752 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing instance network info cache due to event network-changed-eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:11:59.651908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:11:59.652044 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:11:59.652158 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing network info cache for port eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:11:59.692547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:11:59.982715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:11:59.983376 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:11:59.983376 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:00.038149 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 due to new event <LifecycleEvent: 1778638320.037746, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:12:00.038371 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638320.037746, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:00.038539 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Resumed (Lifecycle Event)
May 13 02:12:00.039286 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:00.043269 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance rebooted successfully.
May 13 02:12:00.154910 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:00.195238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-changed-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:00.195238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing instance network info cache due to event network-changed-eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:00.195238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] Acquiring lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:00.542469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:00.551077 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:00.594808 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:00.633847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:00.681128 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance destroyed successfully.
May 13 02:12:00.682613 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'resources' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:00.744341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:00.744341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:00.744341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:00.744631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:00.744703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:00.750512 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Terminating instance
May 13 02:12:00.779212 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:00.779391 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:00.813628 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updated VIF entry in instance network info cache for port eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:00.813852 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:00.873315 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004020270002911275 future=<Future at 0x705c4872ddc0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:00.873530 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:00.873677 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.7775899950001985 future=<Future at 0x705c6c146360 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:00.873810 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.777451436999854 future=<Future at 0x705c6c146360 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:01.053359 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 02:12:01.055132 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638321.0535028, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:01.055132 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Started (Lifecycle Event)
May 13 02:12:01.183818 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:01.184601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoG38eRWKMTGsvpWosYiMin4smUcwcvBohNKwIWkgz90ZYwa4McR0N3k8G7cYX3YOxDixo3/iB71DluH6n0Nl7u031kYLRxzljgfyKObdoMrxQQ5w8sLr5p2ZFqhA3bvQ==',key_name='tempest-keypair-2087693019',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:11:09Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:11:57.176184',shelved_host='np0000000663',shelved_image_id='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:12:01.184763 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:01.185268 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:01.185462 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:12:01.186994 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.187289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5501dcb-71, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:01.188407 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.189508 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:01.190569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.191380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.191563 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9eaaee4-93a4-49c2-83c7-dabe9fa9f542) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:01.192132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.193339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:01.195447 np0000000663 nova-compute[98103]: INFO os_vif [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71')
May 13 02:12:01.195764 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Deleting instance files /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18_del
May 13 02:12:01.202082 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Deletion of /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18_del complete
May 13 02:12:01.258083 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:12:01.282530 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:01.291126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.308089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.315922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-903a2c00-73ac-4561-b895-e2ccee118633 req-af6458a2-ffec-4e7e-85c5-3b7995d67f78 service nova] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:01.317889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] Acquired lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:01.318199 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Refreshing network info cache for port eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:01.328329 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.347875 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:01.347875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:01.347875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:01.348077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:01.348166 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:01.348273 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:12:01.348374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:01.348493 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing instance network info cache due to event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:01.348650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:01.348768 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:01.348872 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:01.351613 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.355156 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.393845 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.394145 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.394400 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.394637 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.397466 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.397674 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.397846 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.398047 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.398178 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:12:01.398336 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:12:01.556525 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:01.560315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:01.560431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:01.560576 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:01.560749 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:77:23:1c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:01.561117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:01.563173 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d2a37ddb-6c79-4f0f-b948-c16bde4b9792 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:01.579879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:01.602309 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Instance destroyed successfully.
May 13 02:12:01.602835 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lazy-loading 'resources' on Instance uuid 35a03c2e-e053-46e6-bb2e-5668f555c78e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:01.766474 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Deleted allocations for instance 94b0397a-4725-422f-97f8-32d7b09d5c18
May 13 02:12:01.796705 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.425s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:01.797984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.104s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:01.798758 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:12:01.825070 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:01.856115 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:01.903958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:02.064003 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 02:12:02.064481 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999803894999786 future=<Future at 0x705c6c6ddeb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:02.109737 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-2027963012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testinstanceswithcindervolumes-server-2027963012',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGzeNpTxUS2g70jLtSgROdpKtQXCo3O1crOCJQo6SwUJt+qdTE8YP6fhLWnIbmAafXHUcq0KEgq6HnGwbP+1/O9Qky1YPyuh9ltMaey5gtHUH3Q7pEegDrAHCE9s4rwfg==',key_name='tempest-TestInstancesWithCinderVolumes-902738017',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:38Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7626320b52f49c0888006226eb492ce',ramdisk_id='',reservation_id='r-2zrjusqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1077980962',owner_user_name='tempest-TestInstancesWithCinderVolumes-1077980962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:10:38Z,user_data=None,user_id='a446089b72fe48f08627c913ee7d5f9e',uuid=35a03c2e-e053-46e6-bb2e-5668f555c78e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:12:02.109737 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converting VIF {"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:02.109737 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:02.109737 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:12:02.111408 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:02.111673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb257c5e-1d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:02.112810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:02.113702 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:02.116699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:02.117850 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:02.118080 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ae655e5-5468-45b1-949b-39deac9a2ae3) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:02.118727 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:02.120714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:02.122913 np0000000663 nova-compute[98103]: INFO os_vif [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:d0:e5,bridge_name='br-int',has_traffic_filtering=True,id=eb257c5e-1da0-42d8-8071-669804e98690,network=Network(fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb257c5e-1d')
May 13 02:12:02.126026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:12:02.126621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:02.126738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:02.134356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:02.136213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fd773d95-c697-47ff-971d-6e661f15b439', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:12:02.136446 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:12:02.148302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:02.148489 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:02.168227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:02.168227 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:02.168227 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:12:02.168227 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:12:02.168227 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:02.168497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:02.168497 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:02.168497 np0000000663 nova-compute[98103]: tcp: [90] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:12:02.168497 np0000000663 nova-compute[98103]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439 (non-flash)
May 13 02:12:02.168497 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:02.168600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '109'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:12:02.172119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '91')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:02.172119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439', '90')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:02.172910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6aaca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'): ({'sdb'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:12:02.173231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:12:02.173494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Flush multipath device 330000000568b5463 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:12:02.232620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:02.250293 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:02.272930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:02.274276 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:02.274320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:02.274460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:02.274577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:02.274674 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] No waiting events found dispatching network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:02.274804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:02.274906 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:02.275027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Acquiring lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:02.275213 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:02.275293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:02.276636 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] No waiting events found dispatching network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:02.276636 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-adc2663a-518c-4c23-949a-ce2f62690d5d req-5841d8a8-7135-49fc-9e06-1753942e017b service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-unplugged-eb257c5e-1da0-42d8-8071-669804e98690 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:02.279240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:02.308501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:12:02.309897 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:12:02.309897 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:02.309897 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:02.336597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:12:02.336597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:12:02.336597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:12:02.344839 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:02.353634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:12:02.353854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:12:02.367030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.403736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.40.100,3260]
May 13 02:12:02.403736 np0000000663 nova-compute[98103]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.40.100,3260] successful.
May 13 02:12:02.403736 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.406929 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99b42dec2d7345d7a446924b3f75142e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '179ca7073b3146308156a52a09a12713', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:12:02.435576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.449771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.477079 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updated VIF entry in instance network info cache for port eb257c5e-1da0-42d8-8071-669804e98690. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:02.477405 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [{"id": "eb257c5e-1da0-42d8-8071-669804e98690", "address": "fa:16:3e:8d:d0:e5", "network": {"id": "fe3c5459-5df1-4d1f-b4c7-e8fd8bb0371d", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-822139667-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c7626320b52f49c0888006226eb492ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb257c5e-1d", "ovs_interfaceid": "eb257c5e-1da0-42d8-8071-669804e98690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:02.479568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.50.100,3260]
May 13 02:12:02.479568 np0000000663 nova-compute[98103]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-fd773d95-c697-47ff-971d-6e661f15b439, portal: 192.168.50.100,3260] successful.
May 13 02:12:02.479568 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.501626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:02.505113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:02.505113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] <== disconnect_volume: return (375ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:02.505113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:12:02.505113 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Deleting instance files /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e_del
May 13 02:12:02.505113 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Deletion of /opt/stack/data/nova/instances/35a03c2e-e053-46e6-bb2e-5668f555c78e_del complete
May 13 02:12:02.545367 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updated VIF entry in instance network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:02.545489 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape5501dcb-71", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:02.651391 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:02.812256 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:12:02.985126 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-db0963e0-f53a-43ff-b7bd-afcdf33ded84 req-d63bd065-7952-4c2b-ad6e-9b1e1ed4273e service nova] Releasing lock "refresh_cache-35a03c2e-e053-46e6-bb2e-5668f555c78e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:03.016363 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Took 1.76 seconds to destroy the instance on the hypervisor.
May 13 02:12:03.017224 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:12:03.020982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:12:03.021158 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:12:03.021477 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:03.036276 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Successfully created port: 4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:12:03.050267 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff708b-ccd3-4cad-8be7-1f0fa097ae72 req-44477fb6-fcb3-4282-afe3-de027eb961af service nova] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:03.155303 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:03.158927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.362s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:03.160865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.257s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:03.160865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:03.161105 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:12:03.161623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.890s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:03.272061 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Deleted allocations for instance 6ba96da7-7f37-4f58-bb18-cc1196420d0c
May 13 02:12:03.317330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:12:03.517067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:03.517329 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:03.626419 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01886079-5ad5-4925-9b04-c9dedcfdfdc5 req-5af6c082-c88f-465b-a8fa-a4f0d21270f5 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Received event network-vif-deleted-eb257c5e-1da0-42d8-8071-669804e98690 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:03.626605 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-01886079-5ad5-4925-9b04-c9dedcfdfdc5 req-5af6c082-c88f-465b-a8fa-a4f0d21270f5 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Neutron deleted interface eb257c5e-1da0-42d8-8071-669804e98690; detaching it from the instance and deleting it from the info cache
May 13 02:12:03.626832 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-01886079-5ad5-4925-9b04-c9dedcfdfdc5 req-5af6c082-c88f-465b-a8fa-a4f0d21270f5 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:03.732370 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Successfully updated port: 4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:12:03.797301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-changed-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:03.798749 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Refreshing instance network info cache due to event network-changed-4b528d45-4efb-4bac-9669-689d24099f4a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:03.799033 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] Acquiring lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:03.799309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] Acquired lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:03.799471 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Refreshing network info cache for port 4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:04.021053 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:04.022166 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:04.136977 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-01886079-5ad5-4925-9b04-c9dedcfdfdc5 req-5af6c082-c88f-465b-a8fa-a4f0d21270f5 service nova] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Detach interface failed, port_id=eb257c5e-1da0-42d8-8071-669804e98690, reason: Instance 35a03c2e-e053-46e6-bb2e-5668f555c78e could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:12:04.205778 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.239129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:04.285314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-29c3f9b5-f124-4ffd-a422-5230b64a0bbd tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Lock "6ba96da7-7f37-4f58-bb18-cc1196420d0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.668s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:04.304253 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:04.328465 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:12:04.329798 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:04.330083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.330743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.330743 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Creating image(s)
May 13 02:12:04.356376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:04.357068 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:04.360122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:04.360930 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:04.365882 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:04.368753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.440411 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:04.445605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.446226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:12:04.453685 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:04.454793 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.487031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.489383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:04.491298 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:04.492389 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:04.499034 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:04.499466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.516121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.516864 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=13715MB free_disk=73.0852279663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:12:04.517747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:04.534334 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.373s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:04.540072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.023s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:04.544015 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Took 1.52 seconds to deallocate network for instance.
May 13 02:12:04.607366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.607525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.687042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk 1073741824" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.687560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:04.687913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.714922 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:04.804959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.805498 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:12:04.805789 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:04.930759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:04.931268 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Cannot resize image /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:12:04.931697 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:12:04.932561 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Ensure instance console log exists: /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:04.932883 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:04.933617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:04.933801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:05.047146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-24a392df-03aa-4da7-b828-9376261944f8 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.740s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:05.135119 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Took 0.59 seconds to detach 1 volumes for instance.
May 13 02:12:05.219019 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-27144e15-c27e-4667-9c15-960056c67709 req-82067284-ecae-44f5-a047-3d491a2281b6 service nova] Releasing lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:05.219650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquired lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:05.219857 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:05.623804 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 35a03c2e-e053-46e6-bb2e-5668f555c78e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:12:05.623926 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:12:05.624076 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:12:05.624229 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance with task_state "unshelving" is not being actively managed by this compute host but has allocations referencing this compute node (97b2898b-d3c3-45e4-a1d2-ef71603b8684): {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1813}}
May 13 02:12:05.624376 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:12:05.624492 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:12:04 up 36 min,  2 users,  load average: 6.89, 7.29, 4.51\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '3', 'num_proj_c7626320b52f49c0888006226eb492ce': '1', 'io_workload': '1', 'num_task_None': '1', 'num_proj_c97b10a192fd43f689e55b4537a4f824': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_179ca7073b3146308156a52a09a12713': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:12:05.643075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:05.650774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:05.829748 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:05.858702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:05.858984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:05.859145 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Unshelving
May 13 02:12:05.894303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:05.918203 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:05.918612 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:06.085003 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:06.248333 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updating instance_info_cache with network_info: [{"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:06.424904 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:06.652782 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0011919009998564434 future=<Future at 0x705c6c146360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:06.652782 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:06.652782 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.8128092429997196 future=<Future at 0x705c6c7117f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:06.652782 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=3.812709566999729 future=<Future at 0x705c6c7117f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:06.653420 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] Emitting event <LifecycleEvent: 1778638311.651184, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:06.653593 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Stopped (Lifecycle Event)
May 13 02:12:06.750275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Releasing lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:06.750611 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance network_info: |[{"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:12:06.752505 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Start _get_guest_xml network_info=[{"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:06.756254 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:06.757403 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-333287025', uuid='1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1'), owner=OwnerMeta(userid='99b42dec2d7345d7a446924b3f75142e', username='tempest-VolumesSnapshotTestJSON-2040320791-project-member', projectid='179ca7073b3146308156a52a09a12713', projectname='tempest-VolumesSnapshotTestJSON-2040320791'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638326.7570224) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:06.759140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:06.759490 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:06.765321 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:06.765567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:06.766643 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:06.767047 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:06.767385 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:06.767385 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:06.767565 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:06.767737 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:06.767861 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:06.768631 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:06.768834 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:06.768968 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:06.769330 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:06.769330 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:06.784675 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-333287025',display_name='tempest-VolumesSnapshotTestJSON-instance-333287025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-333287025',id=47,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiWkTE1vqR5X9jN386AT+/pXoPjrEfxH5dpBpfUAk/x+E1K9Z58XL8ku8kCz2FeCPI9Fi0N/bkXFxpaI+ksXGzjoiBiOP7PYd1QeqepCb9z/CMWY28wPp5cGLb+sLcMtA==',key_name='tempest-keypair-1518700007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-ku1pmc4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:06.784905 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:06.785764 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:06.787036 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:06.932240 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:12:06.932428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.392s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:06.933367 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:12:06.934606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.284s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:06.944816 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:07.120915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.156965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-561df549-bfaa-41c0-8eb8-4031d547fd10 tempest-TestShelveInstance-2050500074 tempest-TestShelveInstance-2050500074-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:07.187063 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:07.187063 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:07.290948 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <uuid>1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1</uuid>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <name>instance-0000002f</name>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-333287025</nova:name>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:06</nova:creationTime>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:user uuid="99b42dec2d7345d7a446924b3f75142e">tempest-VolumesSnapshotTestJSON-2040320791-project-member</nova:user>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:project uuid="179ca7073b3146308156a52a09a12713">tempest-VolumesSnapshotTestJSON-2040320791</nova:project>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         <nova:port uuid="4b528d45-4efb-4bac-9669-689d24099f4a">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="serial">1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="uuid">1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.config"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:7c:d1:6a"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <target dev="tap4b528d45-4e"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/console.log" append="off"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:07.290948 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Preparing to wait for external event network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-333287025',display_name='tempest-VolumesSnapshotTestJSON-instance-333287025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-333287025',id=47,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiWkTE1vqR5X9jN386AT+/pXoPjrEfxH5dpBpfUAk/x+E1K9Z58XL8ku8kCz2FeCPI9Fi0N/bkXFxpaI+ksXGzjoiBiOP7PYd1QeqepCb9z/CMWY28wPp5cGLb+sLcMtA==',key_name='tempest-keypair-1518700007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-ku1pmc4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:07.295760 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:07.298241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.298578 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:07.298914 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:07.302266 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.302692 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1e1e18b-cb93-5e32-9aac-7f8eb2030eef', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:07.306639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.307540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:07.352829 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.355140 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.359438 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.359676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b528d45-4e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:07.360197 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b528d45-4e, col_values=(('qos', UUID('b01cc659-ca8f-4701-a4e7-6205242074ca')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:07.360394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b528d45-4e, col_values=(('external_ids', {'iface-id': '4b528d45-4efb-4bac-9669-689d24099f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:d1:6a', 'vm-uuid': '1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:07.361208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.362699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:07.369600 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:07.370653 np0000000663 nova-compute[98103]: INFO os_vif [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e')
May 13 02:12:07.687400 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:08.196891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.262s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:08.199383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.252s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:08.204917 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_requests' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:08.275577 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Deleted allocations for instance 35a03c2e-e053-46e6-bb2e-5668f555c78e
May 13 02:12:08.591641 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:08.709983 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'numa_topology' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:08.899325 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:08.899423 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:08.899521 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No VIF found with MAC fa:16:3e:7c:d1:6a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:08.899919 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Using config drive
May 13 02:12:09.212252 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:09.212436 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Claim successful on node np0000000663
May 13 02:12:09.286696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-906bbd9b-eaae-4467-bd71-93eccc9ae271 tempest-TestInstancesWithCinderVolumes-1077980962 tempest-TestInstancesWithCinderVolumes-1077980962-project-member] Lock "35a03c2e-e053-46e6-bb2e-5668f555c78e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.543s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:09.409620 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:09.653908 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Creating config drive at /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.config
May 13 02:12:09.660139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaz_be1dw {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:09.672690 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:09.726514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaz_be1dw" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:10.161376 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:12:10.248075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.280270 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.392748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.466053 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005083180003566667 future=<Future at 0x705c6c7117f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:10.469174 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:10.469174 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.597687095999845 future=<Future at 0x705c6c6ddeb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:10.469174 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.597570760000053 future=<Future at 0x705c6c6ddeb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:10.469174 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638315.4654105, 6ba96da7-7f37-4f58-bb18-cc1196420d0c => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:10.469174 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] VM Stopped (Lifecycle Event)
May 13 02:12:10.582753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:10.584148 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:10.615155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-726df853-afb6-4ff3-89ea-2a8132491d40 req-7bf4f2c7-6444-4737-ac5d-2f971dd57ce7 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:10.615306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-726df853-afb6-4ff3-89ea-2a8132491d40 req-7bf4f2c7-6444-4737-ac5d-2f971dd57ce7 service nova] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:10.615558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-726df853-afb6-4ff3-89ea-2a8132491d40 req-7bf4f2c7-6444-4737-ac5d-2f971dd57ce7 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:10.616153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-726df853-afb6-4ff3-89ea-2a8132491d40 req-7bf4f2c7-6444-4737-ac5d-2f971dd57ce7 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:10.616261 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-726df853-afb6-4ff3-89ea-2a8132491d40 req-7bf4f2c7-6444-4737-ac5d-2f971dd57ce7 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Processing event network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:10.644288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.651747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.655056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.664479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.670283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:10.670283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:10.692146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:10.981363 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 6ba96da7-7f37-4f58-bb18-cc1196420d0c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:11.089116 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:11.180119 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:12:11.325767 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638331.3253138, 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:11.325885 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] VM Started (Lifecycle Event)
May 13 02:12:11.329694 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:11.333390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:11.336680 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance spawned successfully.
May 13 02:12:11.337121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:12:11.596164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.398s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:11.596164 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:11.692129 np0000000663 nova-compute[98103]: INFO nova.network.neutron [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating port e5501dcb-7176-4b02-bf66-77b127e32767 with attributes {'binding:host_id': 'np0000000663', 'device_owner': 'compute:nova'}
May 13 02:12:11.774494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:11.774494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:11.776667 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:11.776667 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Claim successful on node np0000000663
May 13 02:12:11.829267 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:11.832271 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:11.847336 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:11.847480 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:11.850668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:11.850668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:11.850668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:11.850668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:12.336417 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:12.337977 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638332.336567, 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:12.337977 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] VM Paused (Lifecycle Event)
May 13 02:12:12.356642 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Took 8.03 seconds to spawn the instance on the hypervisor.
May 13 02:12:12.357726 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:12.359616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:12.360119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:12.360396 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:12.363232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:12.523397 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:12.718897 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:12.719387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:12.719387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:12.719693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:12.719831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] No waiting events found dispatching network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:12.719984 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received unexpected event network-vif-plugged-4b528d45-4efb-4bac-9669-689d24099f4a for instance with vm_state active and task_state None.
May 13 02:12:12.720109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:12.720218 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing instance network info cache due to event network-changed-e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:12.720368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Acquiring lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:12.841636 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:12.847193 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638332.8444932, 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:12.847193 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] VM Resumed (Lifecycle Event)
May 13 02:12:12.871605 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:12.874583 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Took 13.58 seconds to build instance.
May 13 02:12:13.056140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:13.056404 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:13.349469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:13.355715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:13.378909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0b885772-7e0d-4809-8c15-c25eb59cddfc tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.097s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:13.560875 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:14.069783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.301s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:14.070239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:12:14.192017 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-changed-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:14.192258 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Refreshing instance network info cache due to event network-changed-4b528d45-4efb-4bac-9669-689d24099f4a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:14.192474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] Acquiring lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:14.192635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] Acquired lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:14.194877 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Refreshing network info cache for port 4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:14.579140 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:12:14.579532 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:12:14.580118 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:14.580302 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:14.698877 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:14.920847 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfb6eb488f574f7c8f932d1d10c62d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b11777492cc476fb87a83ff007dc8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:12:14.986694 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:15.082751 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:12:15.129555 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:15.586301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:12:15.647812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:15.990659 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Successfully created port: a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:12:16.029665 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:16.467632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:16.532399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:16.533814 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:16.534926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Acquired lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:16.534926 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating image(s)
May 13 02:12:16.536187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:16.536187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:16.537806 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Refreshing network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:16.539426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:16.539868 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:16.575865 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:16.596661 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:12:16.597537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:16.597792 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Creating image(s)
May 13 02:12:16.599368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:16.599593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:16.600110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:16.600804 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:16.604254 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:16.606060 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:16.728004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:16.728004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:16.728520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:16.728977 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:16.731204 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:16.731633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:16.848971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:16.850293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:16.933943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk 1073741824" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:16.936715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:16.936715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:17.045207 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:17.048610 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:17.049948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "f1f9768aab16dc1658b0947d871b06fd178a463a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:17.050817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:17.051457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "f1f9768aab16dc1658b0947d871b06fd178a463a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:17.051873 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:12:17.056623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:17.079855 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.015352146000168432 future=<Future at 0x705c6c6ddeb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:17.086140 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:17.094926 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] Emitting event <LifecycleEvent: 1778638322.0641532, 35a03c2e-e053-46e6-bb2e-5668f555c78e => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:17.095991 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] VM Stopped (Lifecycle Event)
May 13 02:12:17.102276 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:17.131119 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:17.188232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:17.189041 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Cannot resize image /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:12:17.189437 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:12:17.189616 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Ensure instance console log exists: /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:17.189932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:17.190933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:17.190933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:17.368351 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:17.543338 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Successfully updated port: a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:12:17.620172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8f0752cd-5769-42a9-a3df-c78f5a706dca tempest-AttachVolumeMultiAttachTest-2055478852 tempest-AttachVolumeMultiAttachTest-2055478852-project-member] [instance: 35a03c2e-e053-46e6-bb2e-5668f555c78e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:17.661995 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-changed-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:17.662454 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Refreshing instance network info cache due to event network-changed-a727df65-71b2-488b-8320-e9bb1ec13bb6. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:17.662546 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] Acquiring lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:17.662688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] Acquired lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:17.662827 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Refreshing network info cache for port a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:17.785400 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updated VIF entry in instance network info cache for port 4b528d45-4efb-4bac-9669-689d24099f4a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:17.785707 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updating instance_info_cache with network_info: [{"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:18.031014 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:18.052005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:18.170841 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:18.201607 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.206259 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.206968 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:18.257330 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:18.290107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-63b2450f-795f-49aa-9fd0-89c35faa60bb req-05ea1841-a999-4bfa-82bf-48d81593f747 service nova] Releasing lock "refresh_cache-1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:18.342057 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:18.346371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.part --force-share --output=json" returned: 0 in 0.139s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:18.346851 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] f3df9fac-80e8-4bc9-aa58-a8288cca3d0a was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:12:18.348867 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:12:18.349319 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.part /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:18.443782 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updated VIF entry in instance network info cache for port e5501dcb-7176-4b02-bf66-77b127e32767. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:18.445111 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:18.627174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.part /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.converted" returned: 0 in 0.277s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:18.640274 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:18.643396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:18.766039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a.converted --force-share --output=json" returned: 0 in 0.122s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:18.766803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "f1f9768aab16dc1658b0947d871b06fd178a463a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.716s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:18.768072 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.774322 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.782328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:18.929353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json" returned: 0 in 0.147s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:18.929843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "f1f9768aab16dc1658b0947d871b06fd178a463a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:18.930346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "f1f9768aab16dc1658b0947d871b06fd178a463a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:18.930887 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.934049 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:18.934531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:18.956547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af3ee73f-3e81-43cd-9592-c8c67e044a8d req-9ce49990-a326-4f34-8ba7-cbe7ef36b7ef service nova] Releasing lock "refresh_cache-94b0397a-4725-422f-97f8-32d7b09d5c18" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:19.055410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:19.055934 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a,backing_fmt=raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:19.144685 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-716754f6-6136-4b62-ba7d-5f834666c880 req-daacf896-64cf-4ec1-8f92-1a1f19447c3d service nova] Releasing lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:19.145183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquired lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:19.146111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a,backing_fmt=raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk 1073741824" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:19.146496 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:19.150508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "f1f9768aab16dc1658b0947d871b06fd178a463a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:19.150508 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:19.265077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1f9768aab16dc1658b0947d871b06fd178a463a --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:19.265526 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'migration_context' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:19.726940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:19.768783 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:19.769116 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Rebasing disk image.
May 13 02:12:19.769345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:19.807892 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:19.889515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:19.890076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 -F raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:20.037502 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:20.249890 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating instance_info_cache with network_info: [{"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:20.326862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:20.327237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:20.646673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:20.753547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Releasing lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:20.753547 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance network_info: |[{"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:12:20.759235 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Start _get_guest_xml network_info=[{"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:20.763514 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:20.765451 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-89639005', uuid='45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7'), owner=OwnerMeta(userid='bfb6eb488f574f7c8f932d1d10c62d47', username='tempest-VolumesBackupsTest-925143098-project-member', projectid='8b11777492cc476fb87a83ff007dc8b9', projectname='tempest-VolumesBackupsTest-925143098'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638340.7649946) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:20.767482 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:20.768246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:20.774120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:20.774120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:20.774120 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:20.774120 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:20.774120 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:20.774720 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:20.775052 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:20.775313 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:20.775660 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:20.776002 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:20.776281 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:20.776518 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:20.776719 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:20.777827 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:20.795285 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-89639005',display_name='tempest-VolumesBackupsTest-instance-89639005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-89639005',id=48,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCVVNgh/RBkDnU/DSNAwfoYuzsHj7ZBxgNRIIk4KNaNdufhjcJ5dp5Vy+qtP+wvYm+ge3gZCVbPpsOQFjh4ygoy3kyklLltw+zIIHigjBOWtWXRtp8O3cqfVKii0kXBqg==',key_name='tempest-keypair-376662726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-v3jvlqb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:20.795285 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:20.795285 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:20.795285 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'pci_devices' on Instance uuid 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:20.829425 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:12:21.124133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 -F raw /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk" returned: 0 in 1.234s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:21.124997 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:12:21.125394 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Ensure instance console log exists: /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:21.125574 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:21.125796 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:21.125992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:21.128620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start _get_guest_xml network_info=[{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='f554ab3bb898f9a47b183cb57da5ccc9',container_format='bare',created_at=2026-05-13T02:11:50Z,direct_url=<?>,disk_format='qcow2',id=f3df9fac-80e8-4bc9-aa58-a8288cca3d0a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-784631415-shelved',owner='635951473383437bbabc3b1bb776416a',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-13T02:11:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:21.133129 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:21.134603 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-784631415', uuid='94b0397a-4725-422f-97f8-32d7b09d5c18'), owner=OwnerMeta(userid='2554c8defe944528a06bbfd6f360dcd4', username='tempest-AttachVolumeShelveTestJSON-970754436-project-member', projectid='635951473383437bbabc3b1bb776416a', projectname='tempest-AttachVolumeShelveTestJSON-970754436'), image=ImageMeta(id='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638341.134204) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:21.140766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:21.141191 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:21.142337 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:21.142528 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:21.143421 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:21.143778 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f554ab3bb898f9a47b183cb57da5ccc9',container_format='bare',created_at=2026-05-13T02:11:50Z,direct_url=<?>,disk_format='qcow2',id=f3df9fac-80e8-4bc9-aa58-a8288cca3d0a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-784631415-shelved',owner='635951473383437bbabc3b1bb776416a',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-13T02:11:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:21.144003 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:21.144059 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:21.144241 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:21.144420 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:21.144761 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:21.144761 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:21.144761 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:21.144870 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:21.144918 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:21.145593 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:21.145784 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <uuid>45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7</uuid>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <name>instance-00000030</name>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesBackupsTest-instance-89639005</nova:name>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:20</nova:creationTime>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:user uuid="bfb6eb488f574f7c8f932d1d10c62d47">tempest-VolumesBackupsTest-925143098-project-member</nova:user>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:project uuid="8b11777492cc476fb87a83ff007dc8b9">tempest-VolumesBackupsTest-925143098</nova:project>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         <nova:port uuid="a727df65-71b2-488b-8320-e9bb1ec13bb6">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="serial">45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="uuid">45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.config"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:f8:7a:ec"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <target dev="tapa727df65-71"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/console.log" append="off"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:21.301110 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Preparing to wait for external event network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-89639005',display_name='tempest-VolumesBackupsTest-instance-89639005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-89639005',id=48,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCVVNgh/RBkDnU/DSNAwfoYuzsHj7ZBxgNRIIk4KNaNdufhjcJ5dp5Vy+qtP+wvYm+ge3gZCVbPpsOQFjh4ygoy3kyklLltw+zIIHigjBOWtWXRtp8O3cqfVKii0kXBqg==',key_name='tempest-keypair-376662726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-v3jvlqb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:21.301110 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.303232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04a63b9b-f7f8-59f5-a9f6-691a1492db23', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:21.310793 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.315104 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:21.317571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.322208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.322208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa727df65-71, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:21.322208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa727df65-71, col_values=(('qos', UUID('2080586d-d645-4b44-8b93-cf01ff69050c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:21.322382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa727df65-71, col_values=(('external_ids', {'iface-id': 'a727df65-71b2-488b-8320-e9bb1ec13bb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:7a:ec', 'vm-uuid': '45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:21.323231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.324321 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:21.332068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:21.332460 np0000000663 nova-compute[98103]: INFO os_vif [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71')
May 13 02:12:21.409514 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:21.409737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:21.416081 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:21.416789 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Claim successful on node np0000000663
May 13 02:12:21.653738 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:21.671785 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2087693019',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:11:09Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:11:57.176184',shelved_host='np0000000663',shelved_image_id='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:21.672264 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:21.672962 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:21.673623 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'pci_devices' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:22.175834 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <uuid>94b0397a-4725-422f-97f8-32d7b09d5c18</uuid>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <name>instance-0000002e</name>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-784631415</nova:name>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:21</nova:creationTime>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:user uuid="2554c8defe944528a06bbfd6f360dcd4">tempest-AttachVolumeShelveTestJSON-970754436-project-member</nova:user>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:project uuid="635951473383437bbabc3b1bb776416a">tempest-AttachVolumeShelveTestJSON-970754436</nova:project>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         <nova:port uuid="e5501dcb-7176-4b02-bf66-77b127e32767">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="serial">94b0397a-4725-422f-97f8-32d7b09d5c18</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="uuid">94b0397a-4725-422f-97f8-32d7b09d5c18</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:5d:c6:50"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <target dev="tape5501dcb-71"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/console.log" append="off"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:22.178585 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Preparing to wait for external event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:22.178585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:22.183039 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2087693019',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:11:09Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member',shelved_at='2026-05-13T02:11:57.176184',shelved_host='np0000000663',shelved_image_id='f3df9fac-80e8-4bc9-aa58-a8288cca3d0a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:22.184663 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:22.184663 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:22.184663 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:22.185462 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.185694 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:22.185942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:22.186706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.186936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd112b7e-d600-5bf0-ad99-8c4efdc4c828', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:22.188587 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.190485 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:22.195614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.200445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.200656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5501dcb-71, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:22.201175 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5501dcb-71, col_values=(('qos', UUID('7a11e140-6b5b-4884-a769-1a1de1145871')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:22.201379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5501dcb-71, col_values=(('external_ids', {'iface-id': 'e5501dcb-7176-4b02-bf66-77b127e32767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:c6:50', 'vm-uuid': '94b0397a-4725-422f-97f8-32d7b09d5c18'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:22.203193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.204371 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:22.216424 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:22.218396 np0000000663 nova-compute[98103]: INFO os_vif [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71')
May 13 02:12:22.833575 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:22.833805 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:22.854876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:22.855062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:22.855342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No VIF found with MAC fa:16:3e:f8:7a:ec, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:22.855953 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Using config drive
May 13 02:12:23.338502 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:23.362821 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:23.603432 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Creating config drive at /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.config
May 13 02:12:23.608480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76dqdf7z {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:23.681510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp76dqdf7z" returned: 0 in 0.073s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:23.739978 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:23.740183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:23.740369 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] No VIF found with MAC fa:16:3e:5d:c6:50, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:23.741257 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Using config drive
May 13 02:12:23.765556 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:23.850218 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.440s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:23.850567 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:12:24.040437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.206686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.240208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.244355 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.245749 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'ec2_ids' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:24.355724 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.360644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:12:24.360754 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:12:24.362262 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:24.362262 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:24.490336 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:12:24.588254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.619663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.651074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:24.755358 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:24.755358 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'keypairs' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:24.864512 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:12:25.257253 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Object Instance<94b0397a-4725-422f-97f8-32d7b09d5c18> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:25.262249 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:25.296823 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638345.2963502, 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:25.297531 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] VM Started (Lifecycle Event)
May 13 02:12:25.370538 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:12:25.656879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:25.803281 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:25.808838 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638345.8085554, 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:25.809007 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] VM Paused (Lifecycle Event)
May 13 02:12:25.866585 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Successfully created port: d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:12:25.878308 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Booting with volume c42093a9-7d14-4893-8c99-e9327f8e8689 at /dev/vda
May 13 02:12:25.913364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:25.950273 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:25.963611 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:12:25.998045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:26.069335 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:12:26.069771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:12:26.090861 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:12:26.092158 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe7c:d16a', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78'] 
May 13 02:12:26.092332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:12:26.092450 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:12:26.092678 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:26.094307 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Updating existing volume attachment record: 45288c37-9efa-4d8b-9b98-d7eee68ffc18 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:12:26.283413 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:26.310750 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Creating config drive at /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config
May 13 02:12:26.315145 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:26.318989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppe21_l97 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:26.355862 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:26.410140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppe21_l97" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:26.859922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:26.957337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:26.980426 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.090706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.202892 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.348138 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.354124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.362183 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.363346 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:27.391137 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:28.258118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:12:28.258118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:28.258118 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Creating image(s)
May 13 02:12:28.259346 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:12:28.259532 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Ensure instance console log exists: /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:28.259787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:28.260052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:28.260842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:28.287886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f685b6f4-5a7d-42b5-88b4-eeec75534817 req-cb70b199-0c4d-4f35-a207-3ff509f26f53 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:28.287886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f685b6f4-5a7d-42b5-88b4-eeec75534817 req-cb70b199-0c4d-4f35-a207-3ff509f26f53 service nova] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:28.287886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f685b6f4-5a7d-42b5-88b4-eeec75534817 req-cb70b199-0c4d-4f35-a207-3ff509f26f53 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:28.287886 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f685b6f4-5a7d-42b5-88b4-eeec75534817 req-cb70b199-0c4d-4f35-a207-3ff509f26f53 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:28.287886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f685b6f4-5a7d-42b5-88b4-eeec75534817 req-cb70b199-0c4d-4f35-a207-3ff509f26f53 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Processing event network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:28.288370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:28.293117 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638348.2913718, 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:28.293117 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] VM Resumed (Lifecycle Event)
May 13 02:12:28.299462 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:28.306598 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance spawned successfully.
May 13 02:12:28.307052 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:12:28.441592 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:28.442159 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:28.485999 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Successfully updated port: d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:12:28.797008 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:28.805271 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:28.818330 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.818628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.819244 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.819832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.819832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.820161 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:28.945162 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:12:28.991189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:28.991398 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:28.991606 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:29.311838 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:29.312411 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638349.311955, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:29.312411 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Started (Lifecycle Event)
May 13 02:12:29.326888 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Took 12.73 seconds to spawn the instance on the hypervisor.
May 13 02:12:29.327183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:29.514949 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:29.515249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:29.520789 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:29.520988 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Claim successful on node np0000000663
May 13 02:12:29.667083 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:29.815695 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:29.819340 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638349.8187368, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:29.819647 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Paused (Lifecycle Event)
May 13 02:12:29.843726 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Took 18.15 seconds to build instance.
May 13 02:12:29.927115 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:30.325378 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:30.326718 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:30.329507 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:30.348689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.679s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:30.460840 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Updating instance_info_cache with network_info: [{"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:30.645858 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-changed-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:30.645858 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Refreshing instance network info cache due to event network-changed-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:30.646117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Acquiring lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:30.660396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:30.833371 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:30.963127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:30.964670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Instance network_info: |[{"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:12:30.966361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Acquired lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:30.970280 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Start _get_guest_xml network_info=[{"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '07a36dbe-b713-43f3-9ec5-8492bb5d398d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'serial': 'c42093a9-7d14-4893-8c99-e9327f8e8689'}, 'attachment_id': '45288c37-9efa-4d8b-9b98-d7eee68ffc18', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:30.970280 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Refreshing network info cache for port d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:30.981690 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:30.984391 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-415017138', uuid='07a36dbe-b713-43f3-9ec5-8492bb5d398d'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638350.9837277) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:30.985450 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:30.985746 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:30.988441 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:30.989189 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:30.994234 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:30.996287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:30.996287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:30.996287 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:30.997156 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:30.997447 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:30.997786 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:30.998132 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:30.998482 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:30.999977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:30.999977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:30.999977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:30.999977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:30.999977 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:31.022567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:12:31.022567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:31.022567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:31.022785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:31.023354 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:12:31.037558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:31.038085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:31.244070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.206s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:31.245046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:31.245400 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:31.245639 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:31.262395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:31.262395 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:31.269102 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:31.269102 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:31.280815 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689] added
May 13 02:12:31.280815 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:31.280815 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:31.280815 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:31.280815 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:31.280815 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:31.280815 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:31.281085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:31.281242 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:31.281377 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:31.284414 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689] added
May 13 02:12:31.284414 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:31.284414 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:31.284414 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:31.284414 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:31.284414 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:31.284414 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:31.284818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:31.284917 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.04(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:31.285079 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:31.474051 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:31.483552 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-changed-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:31.485183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Refreshing instance network info cache due to event network-changed-a727df65-71b2-488b-8320-e9bb1ec13bb6. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:31.485350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] Acquiring lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:31.485447 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] Acquired lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:31.488760 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Refreshing network info cache for port a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:31.491985 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:31.966528 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:32.006062 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:32.008741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.493s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:32.009296 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:12:32.121047 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Updated VIF entry in instance network info cache for port d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:32.121699 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Updating instance_info_cache with network_info: [{"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:32.206530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:32.282067 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:32.285614 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:32.299692 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:32.299692 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:32.302589 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:32.302589 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.315738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.322549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.328147 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.328147 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.328147 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.328147 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:32.328393 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.328393 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.328393 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.328393 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:32.336824 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.336824 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.336824 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.336824 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:32.337014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.337014 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.337014 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.337014 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:32.354983 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:32.364950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.40.100,3260]
May 13 02:12:32.364950 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.40.100,3260] successful.
May 13 02:12:32.364950 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.374762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.50.100,3260]
May 13 02:12:32.374762 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.50.100,3260] successful.
May 13 02:12:32.374762 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.377178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.388588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:32.397330 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.397330 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.397330 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.397330 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.397330 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.397330 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:32.398007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.398007 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.398007 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.398007 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.398007 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.398007 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:32.398793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.360s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:32.398915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:32.401005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 111 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:32.401295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:32.411085 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.411085 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.411085 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.411085 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.411085 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.411085 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:32.411292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.411292 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:32.411292 np0000000663 nova-compute[98103]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-42c7ee47-b9c5-48b1-aea4-b6b9619c1568 (non-flash)
May 13 02:12:32.411292 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.411292 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:32.411292 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:32.411536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:32.411642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:32.412539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('9', '-', '-', 0) found on session 112 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:32.412539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:32.425029 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 111 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:32.425029 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:32.433624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 112 and hctl ['9', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:32.517491 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:12:32.518308 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:12:32.518308 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:32.518980 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:32.549550 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updated VIF entry in instance network info cache for port a727df65-71b2-488b-8320-e9bb1ec13bb6. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:32.550163 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating instance_info_cache with network_info: [{"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:32.621634 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ace9d025a93d4c5fb3b1282ce9c93c01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1fece695dff4039af32cb0bab816617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:12:32.624521 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Releasing lock "refresh_cache-07a36dbe-b713-43f3-9ec5-8492bb5d398d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:32.624840 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:32.625918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:32.625918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:32.625918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:32.625918 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] No waiting events found dispatching network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:32.625918 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b9f56738-2a03-479f-8567-19989e8608f5 req-b9570692-e2ab-46ad-a3f2-aba46fa8961a service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received unexpected event network-vif-plugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 for instance with vm_state active and task_state None.
May 13 02:12:32.816604 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:33.023906 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:12:33.054541 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8403c008-39c6-479d-a63d-b37e3e009a69 req-51cd31cd-fc69-42ba-8af9-c652a68f5f0a service nova] Releasing lock "refresh_cache-45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:33.114769 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Successfully created port: fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:12:33.435150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 112 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:33.435150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:33.531339 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:12:33.699776 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Successfully updated port: fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:12:33.770978 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-changed-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:33.770978 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Refreshing instance network info cache due to event network-changed-fa51ae16-cd35-4275-a753-10d22e98a1ad. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:33.770978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] Acquiring lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:33.770978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] Acquired lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:33.770978 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Refreshing network info cache for port fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:34.204280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:34.233077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 33000000054255ab4 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:12:34.233425 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.211s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:34.235472 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3213ms) {'type': 'block', 'scsi_wwn': '33000000054255ab4', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000054255ab4'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:34.235634 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000054255ab4', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '33000000054255ab4'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:12:34.270788 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '07a36dbe-b713-43f3-9ec5-8492bb5d398d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'serial': 'c42093a9-7d14-4893-8c99-e9327f8e8689'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:12:34.271262 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:12:34.271425 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:12:34.273687 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:12:34.275546 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:34.297643 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.luks [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 02:12:34.297994 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:12:34.298187 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:12:34.298328 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:12:34.298829 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x705c8815b4a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '07a36dbe-b713-43f3-9ec5-8492bb5d398d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'serial': 'c42093a9-7d14-4893-8c99-e9327f8e8689'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:12:34.299047 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98103) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 02:12:34.354258 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:34.518073 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:34.546150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:12:34.547324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:34.547558 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Creating image(s)
May 13 02:12:34.548069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:34.548394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:34.548830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:34.549438 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:34.552984 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:34.554316 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:34.657243 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:34.657653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:34.658247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:34.658678 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:34.661119 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:12:34.661566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:34.753080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:34.753577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:34.816168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk 1073741824" returned: 0 in 0.062s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:34.816696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:34.817154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:34.934529 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:34.935012 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:12:34.935263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:35.021960 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69d82cb9-0334-4e52-af33-2e95a3709257 req-8435375e-bbdd-4fad-8e03-e13718eff401 service nova] Releasing lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:35.022440 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquired lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:35.022717 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:35.035356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:35.038237 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:12:35.038237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:12:35.038237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:35.038364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:35.038488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:35.038621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:35.593221 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:35.668515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:35.820137 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:35.961329 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Updating instance_info_cache with network_info: [{"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:35.982343 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9801c7b-d426-42d6-81a2-ac2f24be6e2a req-219a6d4b-4f3d-45cd-b011-d52c2d3179c1 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:35.985284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9801c7b-d426-42d6-81a2-ac2f24be6e2a req-219a6d4b-4f3d-45cd-b011-d52c2d3179c1 service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:35.985284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9801c7b-d426-42d6-81a2-ac2f24be6e2a req-219a6d4b-4f3d-45cd-b011-d52c2d3179c1 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:35.985284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c9801c7b-d426-42d6-81a2-ac2f24be6e2a req-219a6d4b-4f3d-45cd-b011-d52c2d3179c1 service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:35.985284 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c9801c7b-d426-42d6-81a2-ac2f24be6e2a req-219a6d4b-4f3d-45cd-b011-d52c2d3179c1 service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Processing event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:35.987212 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance event wait completed in 7 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:35.992616 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638355.99227, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:35.992851 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Resumed (Lifecycle Event)
May 13 02:12:35.995881 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:35.999194 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance spawned successfully.
May 13 02:12:36.453975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:36.454207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:36.454411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:36.454538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:36.454657 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] No waiting events found dispatching network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:36.454821 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-466adf8b-0942-40c4-a702-146d305b9a70 req-62b9612d-f750-4a48-906c-91d79ac396a3 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received unexpected event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 for instance with vm_state building and task_state spawning.
May 13 02:12:36.463191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Releasing lock "refresh_cache-f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:36.463574 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance network_info: |[{"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:12:36.466424 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Start _get_guest_xml network_info=[{"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:36.471130 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:36.474407 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1531621655', uuid='f0ee4c74-d1c8-43c0-9821-8b68bc2f4159'), owner=OwnerMeta(userid='ace9d025a93d4c5fb3b1282ce9c93c01', username='tempest-VolumesActionsTest-278662923-project-member', projectid='e1fece695dff4039af32cb0bab816617', projectname='tempest-VolumesActionsTest-278662923'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638356.4734626) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:36.477479 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:36.479531 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:36.479837 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:36.482082 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:36.487512 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:36.487512 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:36.487512 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:36.487512 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:36.487512 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:36.488478 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:36.488717 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:36.488984 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:36.489272 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:36.489478 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:36.489736 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:36.490238 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:36.490500 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:36.497537 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:36.506781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:36.515344 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531621655',display_name='tempest-VolumesActionsTest-instance-1531621655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1531621655',id=50,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1fece695dff4039af32cb0bab816617',ramdisk_id='',reservation_id='r-ayjs3qex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-278662923',owner_user_name='tempest-VolumesActionsTest-278662923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:34Z,user_data=None,user_id='ace9d025a93d4c5fb3b1282ce9c93c01',uuid=f0ee4c74-d1c8-43c0-9821-8b68bc2f4159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:36.515344 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converting VIF {"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:36.515344 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:36.515344 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:36.993759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-57d52cfc-001c-446e-a161-0e67640fa7b3 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.135s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:37.009449 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:37.018773 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <uuid>f0ee4c74-d1c8-43c0-9821-8b68bc2f4159</uuid>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <name>instance-00000032</name>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumesActionsTest-instance-1531621655</nova:name>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:36</nova:creationTime>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:user uuid="ace9d025a93d4c5fb3b1282ce9c93c01">tempest-VolumesActionsTest-278662923-project-member</nova:user>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:project uuid="e1fece695dff4039af32cb0bab816617">tempest-VolumesActionsTest-278662923</nova:project>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         <nova:port uuid="fa51ae16-cd35-4275-a753-10d22e98a1ad">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="serial">f0ee4c74-d1c8-43c0-9821-8b68bc2f4159</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="uuid">f0ee4c74-d1c8-43c0-9821-8b68bc2f4159</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.config"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:ad:3f:b2"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <target dev="tapfa51ae16-cd"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/console.log" append="off"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:37.018773 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Preparing to wait for external event network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531621655',display_name='tempest-VolumesActionsTest-instance-1531621655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1531621655',id=50,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1fece695dff4039af32cb0bab816617',ramdisk_id='',reservation_id='r-ayjs3qex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-278662923',owner_user_name='tempest-VolumesActionsTest-278662923-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:34Z,user_data=None,user_id='ace9d025a93d4c5fb3b1282ce9c93c01',uuid=f0ee4c74-d1c8-43c0-9821-8b68bc2f4159,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converting VIF {"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:37.021488 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:37.021840 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:37.022970 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.026505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:37.026906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:37.029744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.029988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8ad5f54-0341-5930-a43e-6927228bcf51', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:37.031050 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.031847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:37.032311 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.036929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.037012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa51ae16-cd, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:37.037391 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa51ae16-cd, col_values=(('qos', UUID('a488952b-19c5-40d3-a534-37f4ba4ca887')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:37.037678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa51ae16-cd, col_values=(('external_ids', {'iface-id': 'fa51ae16-cd35-4275-a753-10d22e98a1ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:3f:b2', 'vm-uuid': 'f0ee4c74-d1c8-43c0-9821-8b68bc2f4159'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:37.039081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.041242 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:37.045398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:37.046681 np0000000663 nova-compute[98103]: INFO os_vif [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd')
May 13 02:12:37.258300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:37.258569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:37.763538 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:12:38.058515 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:38.058909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:38.058909 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:38.058970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:38.059153 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:38.059338 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received unexpected event network-vif-plugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with vm_state active and task_state None.
May 13 02:12:38.059524 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:38.059685 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:38.060904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:38.061069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:38.061225 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] No event matching network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad in dict_keys([('network-vif-plugged', 'fa51ae16-cd35-4275-a753-10d22e98a1ad')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:12:38.061387 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ab8f5e43-7678-4f10-8db7-5c958f0fbead req-f166c6a7-96d1-478e-b0d2-09dba8ca824b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received unexpected event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad for instance with vm_state building and task_state spawning.
May 13 02:12:38.312736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:38.313008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:38.316387 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:38.316563 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Claim successful on node np0000000663
May 13 02:12:38.505209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:12:38.505209 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:12:38.505209 np0000000663 nova-compute[98103]:     <volume>c42093a9-7d14-4893-8c99-e9327f8e8689</volume>
May 13 02:12:38.505209 np0000000663 nova-compute[98103]:   </usage>
May 13 02:12:38.505209 np0000000663 nova-compute[98103]: </secret>
May 13 02:12:38.505209 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:12:38.570298 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:38.570525 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:38.570636 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] No VIF found with MAC fa:16:3e:ad:3f:b2, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:38.571182 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Using config drive
May 13 02:12:38.892138 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:38.892385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:39.014557 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-415017138',display_name='tempest-TestVolumeBootPattern-server-415017138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-415017138',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-rzff5g1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:25Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=07a36dbe-b713-43f3-9ec5-8492bb5d398d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:39.014789 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:39.015374 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:39.015869 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 07a36dbe-b713-43f3-9ec5-8492bb5d398d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:39.079022 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:39.248800 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Creating config drive at /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.config
May 13 02:12:39.252203 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_xgymys {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:39.329214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7_xgymys" returned: 0 in 0.077s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:39.394835 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Detaching volume 6539d80f-a83e-4f0c-af1b-860b3f5498d1
May 13 02:12:39.444074 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Attempting to driver detach volume 6539d80f-a83e-4f0c-af1b-860b3f5498d1 from mountpoint /dev/vdb
May 13 02:12:39.449570 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdb by alias ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:12:39.450878 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdb by alias ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:12:39.451009 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Attempting to detach device vdb from instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:12:39.451291 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <alias name="ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1"/>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-2"/>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <serial>6539d80f-a83e-4f0c-af1b-860b3f5498d1</serial>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]: </disk>
May 13 02:12:39.451291 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:12:39.459222 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdb from instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 from the persistent domain config.
May 13 02:12:39.459378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] (1/8): Attempting to detach device vdb with device alias ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1 from instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:12:39.460160 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <alias name="ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1"/>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-2"/>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <serial>6539d80f-a83e-4f0c-af1b-860b3f5498d1</serial>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]: </disk>
May 13 02:12:39.460160 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:12:39.519784 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <uuid>07a36dbe-b713-43f3-9ec5-8492bb5d398d</uuid>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <name>instance-00000031</name>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-415017138</nova:name>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:30</nova:creationTime>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <nova:port uuid="d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="serial">07a36dbe-b713-43f3-9ec5-8492bb5d398d</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="uuid">07a36dbe-b713-43f3-9ec5-8492bb5d398d</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/disk.config"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <alias name="ua-c42093a9-7d14-4893-8c99-e9327f8e8689"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <serial>c42093a9-7d14-4893-8c99-e9327f8e8689</serial>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <encryption format="luks">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:         <secret type="passphrase" uuid="b6a53c0d-dc8e-40ea-9bf6-8e37216e677a"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       </encryption>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:2d:ab:34"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <target dev="tapd0b843da-d5"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/console.log" append="off"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:39.519784 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:39.521673 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Preparing to wait for external event network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:39.521673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:39.521673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:39.521673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:39.522413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-415017138',display_name='tempest-TestVolumeBootPattern-server-415017138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-415017138',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-rzff5g1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:25Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=07a36dbe-b713-43f3-9ec5-8492bb5d398d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:39.522626 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:39.523308 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:39.523556 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:39.523837 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.524286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:39.524560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:39.525921 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.526109 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1743180c-2679-594b-acfc-83ae26d39e59', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:39.527984 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.529869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:39.534488 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.536957 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.537176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0b843da-d5, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:39.537622 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0b843da-d5, col_values=(('qos', UUID('1c5bccd5-35e3-4219-b30c-a3fc97eb0879')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:39.537830 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0b843da-d5, col_values=(('external_ids', {'iface-id': 'd0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:ab:34', 'vm-uuid': '07a36dbe-b713-43f3-9ec5-8492bb5d398d'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:39.538796 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.540368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:39.550176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.551292 np0000000663 nova-compute[98103]: INFO os_vif [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5')
May 13 02:12:39.748949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:39.749162 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:39.849476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.892250 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:39.989780 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.080336 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638360.0796854, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:12:40.081907 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6539d80f-a83e-4f0c-af1b-860b3f5498d1 for instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:12:40.089348 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdb from instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 from the live domain config.
May 13 02:12:40.097718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:12:40.097718 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:40.097718 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:40.097718 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:40.098014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6539d80f-a83e-4f0c-af1b-860b3f5498d1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:12:40.098263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:12:40.127965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:40.127965 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:40.127965 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:40.127965 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:40.127965 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:40.128254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [108] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:40.128254 np0000000663 nova-compute[98103]: tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1 (non-flash)
May 13 02:12:40.128254 np0000000663 nova-compute[98103]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:40.128254 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:40.128254 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:40.128254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '112')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:12:40.128566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '109')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:40.129504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1', '108')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:40.130432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c801d0e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'): ({'sdf'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:12:40.130687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:12:40.131017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flush multipath device 330000000c5d702dd {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:12:40.158749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:40.165571 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-741ec219-2f84-4b42-8256-d1cf1d2a1c44 req-f2a01427-46af-45b8-a2e4-aa78e7c0e624 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:40.165752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-741ec219-2f84-4b42-8256-d1cf1d2a1c44 req-f2a01427-46af-45b8-a2e4-aa78e7c0e624 service nova] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:40.167482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-741ec219-2f84-4b42-8256-d1cf1d2a1c44 req-f2a01427-46af-45b8-a2e4-aa78e7c0e624 service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:40.167655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-741ec219-2f84-4b42-8256-d1cf1d2a1c44 req-f2a01427-46af-45b8-a2e4-aa78e7c0e624 service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:40.167823 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-741ec219-2f84-4b42-8256-d1cf1d2a1c44 req-f2a01427-46af-45b8-a2e4-aa78e7c0e624 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Processing event network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:40.208367 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.210622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:40.216195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.219369 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.248042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.251877 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:40.269485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:12:40.269485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:12:40.271111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:12:40.283671 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:12:40.284025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:12:40.294723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.328008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 109, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260]
May 13 02:12:40.328008 np0000000663 nova-compute[98103]: Logout of [sid: 109, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.40.100,3260] successful.
May 13 02:12:40.328008 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.341028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.353389 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.385810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 108, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260]
May 13 02:12:40.385810 np0000000663 nova-compute[98103]: Logout of [sid: 108, target: iqn.2023-03.storpool.com:os--volume-6539d80f-a83e-4f0c-af1b-860b3f5498d1, portal: 192.168.50.100,3260] successful.
May 13 02:12:40.385810 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.399038 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:40.399311 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:40.399503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== disconnect_volume: return (302ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:40.399668 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:12:40.678610 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:40.762794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.447s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:40.762794 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:12:40.820945 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638360.8193092, f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:40.820945 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] VM Started (Lifecycle Event)
May 13 02:12:40.821544 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:40.828631 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:40.833015 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance spawned successfully.
May 13 02:12:40.833540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:12:40.953571 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:41.068431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:41.068571 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:41.068690 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:2d:ab:34, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:41.069136 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Using config drive
May 13 02:12:41.266299 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:12:41.267238 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:12:41.267547 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:41.269284 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:41.325398 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:41.332702 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:41.341426 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.342404 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.342404 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.342404 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.342736 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.343052 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:41.357925 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8648b9097814fd5848d1e51cbecf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0787f738661944129f59b1250bc5e71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:12:41.576544 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:41.772361 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Creating config drive at /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/disk.config
May 13 02:12:41.774555 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:12:41.786117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpirs92ew7 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:41.836762 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:41.837944 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638361.837441, f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:41.838007 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] VM Paused (Lifecycle Event)
May 13 02:12:41.850160 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Took 7.30 seconds to spawn the instance on the hypervisor.
May 13 02:12:41.850567 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:41.864992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpirs92ew7" returned: 0 in 0.079s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:41.962639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e7450148-696f-402f-92fe-88fa37b97dd2 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.070s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:41.981446 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Successfully created port: 471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:12:42.135427 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:42.135693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:42.135912 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:42.138170 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98103) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 02:12:42.138925 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:42.274631 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:42.275131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:42.276205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:42.276412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:42.276610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] No waiting events found dispatching network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:42.276810 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-211df557-233e-42d1-a979-e478416444fb req-a380ff69-bfe7-4a95-8180-f357beef698b service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received unexpected event network-vif-plugged-fa51ae16-cd35-4275-a753-10d22e98a1ad for instance with vm_state active and task_state None.
May 13 02:12:42.283566 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:12:42.341113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:42.346713 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638362.3455496, f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:42.346713 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] VM Resumed (Lifecycle Event)
May 13 02:12:42.369025 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.376033 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Took 12.92 seconds to build instance.
May 13 02:12:42.403720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.406257 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.511493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.628725 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Successfully updated port: 471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:12:42.756693 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.764332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.769112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.771904 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.795763 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Booting with volume 9e9d715f-d6eb-4864-bcf7-3c215a359c9e at /dev/vda
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-efb49dae-6d99-415d-82b2-4d63b1dadce3 req-5a0626c1-352d-4c01-b4e5-a2c9208666ee service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-efb49dae-6d99-415d-82b2-4d63b1dadce3 req-5a0626c1-352d-4c01-b4e5-a2c9208666ee service nova] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-efb49dae-6d99-415d-82b2-4d63b1dadce3 req-5a0626c1-352d-4c01-b4e5-a2c9208666ee service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-efb49dae-6d99-415d-82b2-4d63b1dadce3 req-5a0626c1-352d-4c01-b4e5-a2c9208666ee service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-efb49dae-6d99-415d-82b2-4d63b1dadce3 req-5a0626c1-352d-4c01-b4e5-a2c9208666ee service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Processing event network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:42.809353 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:42.850497 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:42.858717 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:42.863296 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:42.879181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.437s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:42.880087 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:12:42.917571 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:42.972529 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:12:42.974235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:12:42.990459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:12:42.994250 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fe7c:d16a', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fead:3fb2', 'fe80::fca0:e2ff:febf:f025', 'fe80::fc16:3eff:fe2d:ab34', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:12:42.994250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:12:42.994250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:12:42.994250 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:42.994250 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updating existing volume attachment record: e553d47e-9ca4-4397-9b29-c9659a904903 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:12:43.132342 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:43.132537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquired lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:43.132833 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:43.186081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:43.190801 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:43.215386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:43.219673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:43.254160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:43.408962 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:43.410743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:43.411024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:43.411222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:43.411439 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:43.411610 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-064fbe20-168f-4cc8-9694-d0ee537030d6 req-05616cfa-a005-41ee-95bd-efad47996468 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state active and task_state powering-off.
May 13 02:12:43.512846 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999665388999802 future=<Future at 0x705c6c132300 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:43.513174 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999137126999813 future=<Future at 0x705c6c132300 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:43.514486 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997853310999744 future=<Future at 0x705c6c132300 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:43.517117 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance destroyed successfully.
May 13 02:12:43.517698 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:43.725475 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:12:43.903813 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:44.020948 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:44.020948 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:44.048559 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updating instance_info_cache with network_info: [{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:44.277083 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638364.276434, 07a36dbe-b713-43f3-9ec5-8492bb5d398d => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:44.277346 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] VM Started (Lifecycle Event)
May 13 02:12:44.279073 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:44.283277 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:44.288032 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Instance spawned successfully.
May 13 02:12:44.290330 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:12:44.385266 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-changed-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:44.386166 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Refreshing instance network info cache due to event network-changed-471b8737-87e1-4198-8334-5621db2cf383. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:44.386166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] Acquiring lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:44.534317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-903d94e5-5eaa-4a70-be6c-8744b9c1417a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.398s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:44.540058 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:44.550742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Releasing lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:44.551297 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Instance network_info: |[{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:12:44.551648 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] Acquired lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:44.551879 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Refreshing network info cache for port 471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:44.780135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:44.787821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.802413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] No waiting events found dispatching network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:44.882577 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ee73f72d-bc82-43ad-a6be-8ee1ed29cdf9 req-f9af2138-506f-4190-9d55-09b53dd6bad8 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received unexpected event network-vif-plugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 for instance with vm_state building and task_state spawning.
May 13 02:12:45.054789 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:45.087273 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:45.115442 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:12:45.116744 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:12:45.120241 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Creating image(s)
May 13 02:12:45.120704 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:12:45.120863 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Ensure instance console log exists: /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:12:45.121192 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:45.121352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:45.121476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:45.121956 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Start _get_guest_xml network_info=[{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'acca535f-2ccf-44dc-b45b-1587bcc4561a', 'attached_at': '', 'detached_at': '', 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'serial': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e'}, 'attachment_id': 'e553d47e-9ca4-4397-9b29-c9659a904903', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:45.124629 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:45.126074 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-560457363', uuid='acca535f-2ccf-44dc-b45b-1587bcc4561a'), owner=OwnerMeta(userid='b8648b9097814fd5848d1e51cbecf9a6', username='tempest-TestVolumeBootPatternV346-1111989009-project-member', projectid='0787f738661944129f59b1250bc5e71e', projectname='tempest-TestVolumeBootPatternV346-1111989009'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638365.1256993) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:45.127247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:45.127571 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:45.128476 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:45.128645 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:45.129527 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:45.129862 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:45.130022 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:45.130138 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:45.130258 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:45.130330 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:45.130421 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:45.130563 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:45.130652 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:45.130755 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:45.130862 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:45.130969 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:45.140958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:12:45.141260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:45.141416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:45.142298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:45.142565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:12:45.157702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:45.157702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:45.157944 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:45.158544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:45.159118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:45.159281 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:45.169403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:45.169403 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:45.181355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:45.181355 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:45.186817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e] added
May 13 02:12:45.186817 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:45.186817 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:45.186817 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:45.186817 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:45.186817 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:45.186817 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:45.187200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:45.188222 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:45.188222 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:45.192456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e] added
May 13 02:12:45.192456 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:45.192456 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:45.192456 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:45.192456 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:45.192456 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:45.192456 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:45.193595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:45.193595 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:45.193595 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:45.295908 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:45.296296 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638365.2960138, 07a36dbe-b713-43f3-9ec5-8492bb5d398d => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:45.296488 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] VM Paused (Lifecycle Event)
May 13 02:12:45.307775 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Took 17.05 seconds to spawn the instance on the hypervisor.
May 13 02:12:45.307967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:45.404387 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:45.492646 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:45.492848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:45.493010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:45.494369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:45.494677 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:45.494877 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b5d296cb-6d20-4f19-b4c1-9b7bd33d19af req-418f08cf-7f86-45cf-92d2-2f41d6a7404c service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:12:45.593110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:45.593491 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquired lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:45.593491 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:12:45.593491 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'info_cache' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:45.614558 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updated VIF entry in instance network info cache for port 471b8737-87e1-4198-8334-5621db2cf383. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:45.614789 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updating instance_info_cache with network_info: [{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:45.677962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:45.803406 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:45.806252 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638365.8059459, 07a36dbe-b713-43f3-9ec5-8492bb5d398d => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:45.806490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] VM Resumed (Lifecycle Event)
May 13 02:12:45.823753 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Took 24.48 seconds to build instance.
May 13 02:12:46.097290 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:46.117143 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8a0aeba9-7dcf-4c74-bc87-c0e8acb793b0 req-2bcbd53e-74ad-430e-bf4e-ae0896bfa3f9 service nova] Releasing lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:46.188170 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:46.194113 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:46.205870 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:46.205870 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:46.215139 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:46.215139 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.225466 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.233827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.242319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.242319 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.242319 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:46.242498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.242498 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.242498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:46.244819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.244819 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.244819 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:46.245084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.245084 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.245084 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:46.283303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.50.100,3260]
May 13 02:12:46.283303 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.50.100,3260] successful.
May 13 02:12:46.283303 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.291055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.40.100,3260]
May 13 02:12:46.291055 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.40.100,3260] successful.
May 13 02:12:46.291055 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.299298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.304784 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:46.316120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:46.316120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.316120 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.316120 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.316120 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.316120 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:46.318149 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:46.321402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.321402 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.321402 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.321402 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.321402 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:46.330070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.330070 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.330070 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.330070 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.330070 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:46.332011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:46.335172 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:46.335172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:46.336259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:46.336259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('10', '-', '-', 0) found on session 114 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:46.336259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:46.336732 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('7', '-', '-', 0) found on session 113 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:46.336826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:46.362049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 114 and hctl ['10', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:46.362049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:46.362049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 113 and hctl ['7', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:46.362049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:46.598354 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:46.830603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:46.830877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:46.831172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:46.831338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:46.831489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:46.832956 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 02:12:46.841253 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Terminating instance
May 13 02:12:47.028471 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:47.159702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:12:47.173449 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:47.347991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:12:47.379660 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.385121 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.413603 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.419122 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.441731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.450856 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.628200 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:47.628635 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:47.628754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:47.628813 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:47.629432 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] No waiting events found dispatching network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:47.629432 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50c0ee36-05f6-4c6b-b09a-0c5c34da7255 req-c3962013-c5a8-46d7-beea-4913ee0d5249 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:47.669716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:47.682219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Releasing lock "refresh_cache-0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:47.688290 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999728215000232 future=<Future at 0x705c6c63a120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:47.692296 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Instance destroyed successfully.
May 13 02:12:47.695186 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 07a36dbe-b713-43f3-9ec5-8492bb5d398d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:48.174957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Found WWN 330000000cc36192a for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:12:48.175242 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:48.175406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000cc36192a', 'path': '/dev/dm-1', 'multipath_id': '330000000cc36192a'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:48.175523 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc36192a', 'path': '/dev/dm-1', 'multipath_id': '330000000cc36192a'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:12:48.198864 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-415017138',display_name='tempest-TestVolumeBootPattern-server-415017138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-415017138',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:45Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-rzff5g1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:45Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=07a36dbe-b713-43f3-9ec5-8492bb5d398d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:12:48.198864 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "address": "fa:16:3e:2d:ab:34", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0b843da-d5", "ovs_interfaceid": "d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:48.198864 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:48.198864 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:12:48.200653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.200893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0b843da-d5, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:48.201961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.202926 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:48.208148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.209108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.209284 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c5bccd5-35e3-4219-b30c-a3fc97eb0879) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:48.209772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.210398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:48.215103 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.217353 np0000000663 nova-compute[98103]: INFO os_vif [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ab:34,bridge_name='br-int',has_traffic_filtering=True,id=d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0b843da-d5')
May 13 02:12:48.219416 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:12:48.219834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:48.220108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:48.220644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:48.221024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c42093a9-7d14-4893-8c99-e9327f8e8689', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:12:48.221296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689 (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:48.248670 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:12:48.248670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '111')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:48.249908 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689', '112')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:12:48.250670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c6de0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:12:48.251014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdd, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:12:48.251308 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 33000000054255ab4 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:12:48.286733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:48.334729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:12:48.385456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:12:48.385456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:12:48.385456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:12:48.402067 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:12:48.402067 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:12:48.414532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.440784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:48.440944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:48.441450 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:48.441450 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:48.441450 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:48.443477 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Terminating instance
May 13 02:12:48.444478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.40.100,3260]
May 13 02:12:48.444478 np0000000663 nova-compute[98103]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.40.100,3260] successful.
May 13 02:12:48.444478 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.461039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.472495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.503294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.50.100,3260]
May 13 02:12:48.503294 np0000000663 nova-compute[98103]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-c42093a9-7d14-4893-8c99-e9327f8e8689, portal: 192.168.50.100,3260] successful.
May 13 02:12:48.503294 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.516488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:48.518133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:48.518133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (298ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:48.518133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:12:48.518133 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Deleting instance files /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d_del
May 13 02:12:48.518887 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Deletion of /opt/stack/data/nova/instances/07a36dbe-b713-43f3-9ec5-8492bb5d398d_del complete
May 13 02:12:48.680213 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-560457363',display_name='tempest-TestVolumeBootPatternV346-server-560457363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-560457363',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgBiik/d00pl/LysR7NbLbEx8WOlXshAiYHABdO+pl3pDu1X/5kFrLeUOZ7F4FebX9d4FtwAyLxX+lV2OtqsRRVM1MCwpq/CxkEKXEpMwG99YXcqIM1w3S/OEurLuKbQ==',key_name='tempest-keypair-1213351973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-xu17ldyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=acca535f-2ccf-44dc-b45b-1587bcc4561a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:48.680626 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:48.680776 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:48.681313 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'pci_devices' on Instance uuid acca535f-2ccf-44dc-b45b-1587bcc4561a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:48.696595 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance destroyed successfully.
May 13 02:12:48.697958 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:48.947219 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:12:48.970420 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.973472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:48.999767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.003755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.027741 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Took 1.68 seconds to destroy the instance on the hypervisor.
May 13 02:12:49.028210 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:12:49.028472 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:12:49.028560 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:12:49.028771 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:49.031101 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] No waiting events found dispatching network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:49.146615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d986735-806d-46c9-a6d3-64b578b7f5e7 req-47ce5829-e529-4410-b43e-601d954583fe service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:49.185744 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <uuid>acca535f-2ccf-44dc-b45b-1587bcc4561a</uuid>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <name>instance-00000033</name>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPatternV346-server-560457363</nova:name>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:45</nova:creationTime>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:user uuid="b8648b9097814fd5848d1e51cbecf9a6">tempest-TestVolumeBootPatternV346-1111989009-project-member</nova:user>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:project uuid="0787f738661944129f59b1250bc5e71e">tempest-TestVolumeBootPatternV346-1111989009</nova:project>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         <nova:port uuid="471b8737-87e1-4198-8334-5621db2cf383">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="serial">acca535f-2ccf-44dc-b45b-1587bcc4561a</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="uuid">acca535f-2ccf-44dc-b45b-1587bcc4561a</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/disk.config"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <alias name="ua-9e9d715f-d6eb-4864-bcf7-3c215a359c9e"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-1"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <serial>9e9d715f-d6eb-4864-bcf7-3c215a359c9e</serial>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:59:26:21"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <target dev="tap471b8737-87"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/console.log" append="off"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:49.185744 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:49.187526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Preparing to wait for external event network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:12:49.187526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:49.187526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:49.187526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:49.187661 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-560457363',display_name='tempest-TestVolumeBootPatternV346-server-560457363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-560457363',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgBiik/d00pl/LysR7NbLbEx8WOlXshAiYHABdO+pl3pDu1X/5kFrLeUOZ7F4FebX9d4FtwAyLxX+lV2OtqsRRVM1MCwpq/CxkEKXEpMwG99YXcqIM1w3S/OEurLuKbQ==',key_name='tempest-keypair-1213351973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-xu17ldyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=acca535f-2ccf-44dc-b45b-1587bcc4561a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:49.188969 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:49.188969 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:49.188969 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:49.189258 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.189482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.189739 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:49.190514 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.190736 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd8c14ef-8f74-5754-9d73-5b1efc70c54d', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.192812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.193515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.198913 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:49.199196 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'resources' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:49.203246 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.206022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.206022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471b8737-87, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.206022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap471b8737-87, col_values=(('qos', UUID('b5c21064-243b-4047-921a-164386c80734')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.206022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap471b8737-87, col_values=(('external_ids', {'iface-id': '471b8737-87e1-4198-8334-5621db2cf383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:26:21', 'vm-uuid': 'acca535f-2ccf-44dc-b45b-1587bcc4561a'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.207963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.207963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.220566 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.221665 np0000000663 nova-compute[98103]: INFO os_vif [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87')
May 13 02:12:49.288472 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99975318099996 future=<Future at 0x705c6c69ec60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:49.290477 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Instance destroyed successfully.
May 13 02:12:49.290933 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lazy-loading 'resources' on Instance uuid f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:49.615047 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:49.693220 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:49.693220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] Acquiring lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:49.693220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:49.693220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:49.693614 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] No waiting events found dispatching network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:49.693641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce89a092-1d84-4ec7-afb6-7884560e051d req-012f47e3-2bf7-4f15-a52d-11c4e8ccfeaf service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-unplugged-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:49.702641 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:49.703334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:12:49.703512 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:49.703989 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:49.704209 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:12:49.705010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.707325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c5c508-74, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.715961 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.717864 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.726427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.727221 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.727221 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b98050d5-952e-47b4-a7ab-6643ecbc6548) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.728456 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.729011 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.736503 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.740212 np0000000663 nova-compute[98103]: INFO os_vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:12:49.749969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start _get_guest_xml network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:12:49.753793 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:12:49.754799 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-101663398', uuid='0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'), owner=OwnerMeta(userid='3b3cc512843b427fa59414fdf92f5e76', username='tempest-AttachVolumeTestJSON-1185409082-project-member', projectid='c97b10a192fd43f689e55b4537a4f824', projectname='tempest-AttachVolumeTestJSON-1185409082'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638369.7545207) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:12:49.757071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:12:49.757579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:12:49.758561 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:12:49.758886 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:12:49.760106 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:12:49.761061 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:12:49.761854 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:12:49.762005 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:12:49.762456 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:12:49.762831 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:12:49.762913 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:12:49.763108 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:12:49.763468 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:12:49.763712 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:12:49.763904 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:12:49.764342 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:12:49.764552 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:49.793180 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531621655',display_name='tempest-VolumesActionsTest-instance-1531621655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesactionstest-instance-1531621655',id=50,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:41Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1fece695dff4039af32cb0bab816617',ramdisk_id='',reservation_id='r-ayjs3qex',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-278662923',owner_user_name='tempest-VolumesActionsTest-278662923-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:42Z,user_data=None,user_id='ace9d025a93d4c5fb3b1282ce9c93c01',uuid=f0ee4c74-d1c8-43c0-9821-8b68bc2f4159,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:12:49.793387 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converting VIF {"id": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "address": "fa:16:3e:ad:3f:b2", "network": {"id": "46d0c410-e22e-4b8b-920e-c249780f01ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1462023513-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e1fece695dff4039af32cb0bab816617", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa51ae16-cd", "ovs_interfaceid": "fa51ae16-cd35-4275-a753-10d22e98a1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:49.793849 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:49.794044 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:12:49.794927 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.796070 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa51ae16-cd, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.796413 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.798157 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.804346 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.809219 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.809219 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a488952b-19c5-40d3-a534-37f4ba4ca887) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:49.811072 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.811598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:49.819836 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:49.821731 np0000000663 nova-compute[98103]: INFO os_vif [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:3f:b2,bridge_name='br-int',has_traffic_filtering=True,id=fa51ae16-cd35-4275-a753-10d22e98a1ad,network=Network(46d0c410-e22e-4b8b-920e-c249780f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa51ae16-cd')
May 13 02:12:49.822138 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Deleting instance files /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159_del
May 13 02:12:49.822715 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Deletion of /opt/stack/data/nova/instances/f0ee4c74-d1c8-43c0-9821-8b68bc2f4159_del complete
May 13 02:12:50.267393 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:50.277035 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:12:50.277291 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:50.277689 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:50.278176 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:50.329030 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Took 1.38 seconds to destroy the instance on the hypervisor.
May 13 02:12:50.329617 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:12:50.329915 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:12:50.330046 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:12:50.330318 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:50.345477 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:50.437867 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:50.464371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:50.464795 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:50.681035 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:50.744128 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:50.744128 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:50.744748 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No VIF found with MAC fa:16:3e:59:26:21, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:50.744748 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Using config drive
May 13 02:12:50.780006 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:50.780998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] End _get_guest_xml xml=<domain type="qemu">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <uuid>0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</uuid>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <name>instance-0000002d</name>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeTestJSON-server-101663398</nova:name>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:12:49</nova:creationTime>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:user uuid="3b3cc512843b427fa59414fdf92f5e76">tempest-AttachVolumeTestJSON-1185409082-project-member</nova:user>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:project uuid="c97b10a192fd43f689e55b4537a4f824">tempest-AttachVolumeTestJSON-1185409082</nova:project>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         <nova:port uuid="28c5c508-74e7-4622-8bbe-b35276f1e65c">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <system>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="serial">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="uuid">0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </system>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <os>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </os>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <features>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </features>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   <devices>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk.config"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </disk>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:77:23:1c"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <target dev="tap28c5c508-74"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </interface>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/console.log" append="off"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </serial>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <video>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </video>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </rng>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:   </devices>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]: </domain>
May 13 02:12:50.780998 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:12:50.783952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:50.848786 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Took 1.82 seconds to deallocate network for instance.
May 13 02:12:50.876501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:50.876915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:50.963047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:50.964013 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:50.970040 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:51.178917 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:51.253942 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:51.254898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] Acquiring lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:51.256646 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:51.259919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:51.260323 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:51.260473 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] No waiting events found dispatching network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:51.260606 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-unplugged-fa51ae16-cd35-4275-a753-10d22e98a1ad for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:12:51.260719 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Received event network-vif-deleted-d0b843da-d5a6-4c9c-b7d0-8a709aa5ccc6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:51.260925 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-126e3697-3360-4a04-8c9d-b83afafdac64 req-79c059fe-e1ec-49ca-b30c-8eaea7ce5047 service nova] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Received event network-vif-deleted-fa51ae16-cd35-4275-a753-10d22e98a1ad {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:51.367444 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Creating config drive at /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/disk.config
May 13 02:12:51.371085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5iixltds {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:51.408695 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:12:51.427505 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5iixltds" returned: 0 in 0.056s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:51.468000 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:51.468539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:51.500031 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Ignoring supplied device name: /dev/vdb
May 13 02:12:51.571446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:51.571857 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:12:51.572378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:51.662783 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:12:51.663215 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:12:51.663517 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:51.682925 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Took 1.35 seconds to deallocate network for instance.
May 13 02:12:51.886263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:51.911247 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:51.914849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:51.923282 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:51.923282 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:52.004126 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.539s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:52.038584 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.169022 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Object Instance<0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:12:52.169022 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:12:52.169022 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:12:52.169022 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:12:52.169022 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:12:52.169570 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.169711 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:52.170054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:12:52.171082 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.171307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0d0df4c-23da-5f98-be2f-42d81ff94be5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:52.172650 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.173627 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:52.173627 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.175082 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.175245 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28c5c508-74, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:52.175549 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28c5c508-74, col_values=(('qos', UUID('fd66527d-f94b-46ea-8c2f-0f23cd91b4e4')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:52.175699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28c5c508-74, col_values=(('external_ids', {'iface-id': '28c5c508-74e7-4622-8bbe-b35276f1e65c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:23:1c', 'vm-uuid': '0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:12:52.177906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.179342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:12:52.185309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.187452 np0000000663 nova-compute[98103]: INFO os_vif [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:12:52.191120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:52.224217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.231477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.262233 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.268697 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.365620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:52.365822 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:52.676645 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.709272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.816121 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:52.868857 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:53.006190 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638373.005686, acca535f-2ccf-44dc-b45b-1587bcc4561a => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:53.006850 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] VM Started (Lifecycle Event)
May 13 02:12:53.039991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:53.040270 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:53.040503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:53.045274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:53.047958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:53.047958 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:53.047958 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-af9fb575-c746-453e-b283-a78d6f2b66c8 req-5f211912-1255-4186-9814-9920ff5a0c78 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:12:53.051071 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:53.060489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:53.060587 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:53.060804 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Attaching volume d203859f-c3f2-4302-8fa3-f0dd316fdb0f to /dev/vdb
May 13 02:12:53.082759 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:53.118225 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:53.130309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:12:53.159120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:12:53.216806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:12:53.217231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:12:53.227923 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:12:53.229532 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7c:d16a', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5'] 
May 13 02:12:53.229785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:12:53.229995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:12:53.230338 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:53.230664 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updating existing volume attachment record: 0305f059-0530-4e96-b07f-a8ea8e3278d8 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:12:53.313900 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:53.314068 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:53.314350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:53.314901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:53.314901 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Processing event network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:12:53.314989 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:53.315202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:53.315902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:53.319469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:53.319586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:53.319711 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] No waiting events found dispatching network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:53.319849 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-40dcae9d-0725-4ac3-8034-a8f9ec438a66 req-44a4cf73-8677-485a-b463-de92f082e398 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received unexpected event network-vif-plugged-471b8737-87e1-4198-8334-5621db2cf383 for instance with vm_state building and task_state spawning.
May 13 02:12:53.325470 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:12:53.329442 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Instance spawned successfully.
May 13 02:12:53.330194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:12:53.378993 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.456s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:53.381602 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:53.465412 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 07a36dbe-b713-43f3-9ec5-8492bb5d398d
May 13 02:12:53.509784 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:53.514320 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:53.726411 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:12:53.729318 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance rebooted successfully.
May 13 02:12:53.784524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:12:53.784939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:12:53.785080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:53.785543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:53.785837 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:12:53.805928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:53.806513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:53.806943 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:53.807541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:12:53.808116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:12:53.808327 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:53.819808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:53.819808 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:53.827838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:12:53.827838 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f] added
May 13 02:12:53.841041 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:53.841041 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:53.841041 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:53.843037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.843037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.843508 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.844274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.844664 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.845027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:12:53.850310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f] added
May 13 02:12:53.850310 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:12:53.850310 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:53.850310 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:53.850310 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:12:53.850310 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:12:53.850310 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:53.851256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:12:53.851591 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0432(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:12:53.851737 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:12:53.853776 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:12:53.854147 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:12:54.017656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:12:54.018260 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638374.0177875, acca535f-2ccf-44dc-b45b-1587bcc4561a => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:54.018260 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] VM Paused (Lifecycle Event)
May 13 02:12:54.353598 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Took 9.24 seconds to spawn the instance on the hypervisor.
May 13 02:12:54.353830 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:54.357306 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:12:54.474150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0eee5727-a20a-44bc-99e2-670808f8c197 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "07a36dbe-b713-43f3-9ec5-8492bb5d398d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.643s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:54.520905 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:54.525128 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638374.5247996, acca535f-2ccf-44dc-b45b-1587bcc4561a => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:54.525325 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] VM Resumed (Lifecycle Event)
May 13 02:12:54.839000 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:12:54.854804 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:54.856038 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:54.856038 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.870263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.489s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:54.875593 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Took 16.61 seconds to build instance.
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:12:54.876727 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:12:54.876727 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.879742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.893924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.904547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.904547 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.904547 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:54.904778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.904778 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.904778 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:54.910568 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.910568 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.910568 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:54.910751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.910751 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.910751 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:54.943855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.40.100,3260]
May 13 02:12:54.943855 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.40.100,3260] successful.
May 13 02:12:54.943855 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.950291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.50.100,3260]
May 13 02:12:54.950291 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.50.100,3260] successful.
May 13 02:12:54.950291 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.954134 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Deleted allocations for instance f0ee4c74-d1c8-43c0-9821-8b68bc2f4159
May 13 02:12:54.960924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.969053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:12:54.980084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.980084 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.980084 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.980084 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.980084 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:54.980650 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.980650 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.980650 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.980650 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.980650 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:54.980983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:54.981132 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:54.982037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] HCTL ('8', '-', '-', 0) found on session 115 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:54.982193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:54.987374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.987374 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.987374 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.987374 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.987374 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:12:54.987783 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.987783 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:12:54.987783 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.987783 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:12:54.987783 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:12:54.987783 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:54.988081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:12:54.988576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] HCTL ('9', '-', '-', 0) found on session 116 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:12:54.988722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:12:55.005508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 115 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:55.005508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:55.010341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 116 and hctl ['9', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:55.027830 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:55.034197 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:55.124381 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:55.126053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:55.126053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:55.126053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:55.126053 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:12:55.126053 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ce0c105f-1395-40e6-9659-f9428ab1e546 req-011fe7ce-5e80-4c99-b981-70491c940c29 service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received unexpected event network-vif-plugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with vm_state stopped and task_state powering-on.
May 13 02:12:55.240481 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:55.240627 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:55.240732 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:77:23:1c, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:55.241105 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4893dbf-8626-4eed-aee6-5b6c7658ff2e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:55.378035 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.119s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:55.540799 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 due to new event <LifecycleEvent: 1778638375.5404603, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:12:55.540928 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638375.5404603, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:55.541036 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Resumed (Lifecycle Event)
May 13 02:12:55.682879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:55.783238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-changed-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:12:55.783612 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Refreshing instance network info cache due to event network-changed-471b8737-87e1-4198-8334-5621db2cf383. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:12:55.784082 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] Acquiring lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:12:55.784252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] Acquired lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:12:55.784394 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Refreshing network info cache for port 471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:12:55.970228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-9f0907a2-ab73-46f0-8975-45293a3add6d tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Lock "f0ee4c74-d1c8-43c0-9821-8b68bc2f4159" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.527s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:12:56.010326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Searching for a device in session 116 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:12:56.010536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:12:56.043287 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:56.046624 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:56.286229 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:56.549121 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638376.5487156, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:12:56.549350 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Started (Lifecycle Event)
May 13 02:12:56.684895 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:12:56.834113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found WWN 330000000860e3ab2 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:12:56.834113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:12:56.834113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000860e3ab2', 'path': '/dev/dm-0', 'multipath_id': '330000000860e3ab2'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:12:56.834113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000860e3ab2', 'path': '/dev/dm-0', 'multipath_id': '330000000860e3ab2'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:12:56.836664 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:12:56.865957 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updated VIF entry in instance network info cache for port 471b8737-87e1-4198-8334-5621db2cf383. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:12:56.866187 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updating instance_info_cache with network_info: [{"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:12:57.053027 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:12:57.055039 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:12:57.178785 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:12:57.339917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Attempting to attach volume d203859f-c3f2-4302-8fa3-f0dd316fdb0f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:12:57.343086 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:   <alias name="ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f"/>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:   <serial>d203859f-c3f2-4302-8fa3-f0dd316fdb0f</serial>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]: </disk>
May 13 02:12:57.343086 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:12:57.368701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d6dcb9ad-0da0-4a5c-92c6-1d428096b231 req-35b8648f-8cc2-478f-b096-2d9018c7e1b1 service nova] Releasing lock "refresh_cache-acca535f-2ccf-44dc-b45b-1587bcc4561a" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:12:58.512732 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0003908950002369238 future=<Future at 0x705c6c132300 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:58.513216 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:58.513216 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.175023926999984 future=<Future at 0x705c6c63a120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:58.513216 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.174934591000238 future=<Future at 0x705c6c63a120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:12:58.815714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:58.815955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:59.034285 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:59.034477 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:59.034477 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:12:59.034618 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No VIF found with MAC fa:16:3e:7c:d1:6a, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:12:59.318509 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:12:59.871994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:12:59.872462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:12:59.875929 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:12:59.876162 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Claim successful on node np0000000663
May 13 02:13:00.025421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:00.596994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b615e414-c840-4c00-b5c4-b4cacf6ed8ea tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.536s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:00.688979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:01.225487 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:01.226013 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:01.728545 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:01.798527 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:02.180770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:02.236752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.365s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:02.237292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:02.688468 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00043066899979748996 future=<Future at 0x705c6c63a120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:02.689679 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638367.6879241, 07a36dbe-b713-43f3-9ec5-8492bb5d398d => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:02.689916 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:02.690188 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] VM Stopped (Lifecycle Event)
May 13 02:13:02.694114 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.5967898600001718 future=<Future at 0x705c6c69ec60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:02.694114 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.596651503999965 future=<Future at 0x705c6c69ec60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:02.742665 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:02.744010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:02.744010 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:02.744315 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:02.843473 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:03.194224 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-094a0b6f-4cd5-4f14-811a-b0abafe949cf tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 07a36dbe-b713-43f3-9ec5-8492bb5d398d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:03.243860 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:03.277190 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Successfully created port: 9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:03.750984 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:03.826668 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Successfully updated port: 9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:03.889701 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-changed-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:03.889701 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Refreshing instance network info cache due to event network-changed-9b08e0f3-b210-4de9-91f8-a9edbb687f26. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:03.889838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] Acquiring lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:03.889958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] Acquired lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:03.890105 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Refreshing network info cache for port 9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:04.254465 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Booting with volume c28090ee-099f-45a3-93b4-7a17b515cde9 at /dev/vda
May 13 02:13:04.289143 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.000874471999850357 future=<Future at 0x705c6c69ec60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:04.290012 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:04.290364 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] Emitting event <LifecycleEvent: 1778638369.2881444, f0ee4c74-d1c8-43c0-9821-8b68bc2f4159 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:04.290563 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] VM Stopped (Lifecycle Event)
May 13 02:13:04.296793 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:04.310406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:13:04.328941 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:04.340154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:04.393627 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:04.397572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:13:04.398519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe7c:d16a', 'fe80::303e:5eff:fe5e:d4c4', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5'] 
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:04.409153 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Updating existing volume attachment record: b66c3032-b9fd-4f3d-ba74-3e801b1cb4e3 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:13:04.472472 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:04.624560 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:04.757463 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:04.793440 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-05a4e183-f9d5-4309-9cf1-0762bd19ac4e tempest-VolumesActionsTest-278662923 tempest-VolumesActionsTest-278662923-project-member] [instance: f0ee4c74-d1c8-43c0-9821-8b68bc2f4159] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:05.128109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0bced7de-d069-4ed0-8ca4-e4be0701d553 req-0d556b79-d9c6-496d-a4f9-2dda46e295f5 service nova] Releasing lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:05.128892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:05.129104 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:05.697048 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:05.724750 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:05.879003 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:06.055057 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Updating instance_info_cache with network_info: [{"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:06.526586 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:06.527885 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:06.528157 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Creating image(s)
May 13 02:13:06.528434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:13:06.528579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Ensure instance console log exists: /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:06.528837 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:06.529069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:06.529258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:06.558435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-1b968225-d390-4e02-9871-58d0713ff39b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:06.558435 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance network_info: |[{"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:06.559527 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Start _get_guest_xml network_info=[{"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1b968225-d390-4e02-9871-58d0713ff39b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'serial': 'c28090ee-099f-45a3-93b4-7a17b515cde9'}, 'attachment_id': 'b66c3032-b9fd-4f3d-ba74-3e801b1cb4e3', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:06.563391 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:06.565314 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2099697253', uuid='1b968225-d390-4e02-9871-58d0713ff39b'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638386.5646608) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:06.567402 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:06.567961 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:06.569180 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:06.569418 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:06.570652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:06.571070 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:06.571427 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:06.571427 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:06.571786 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:06.571786 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:06.571872 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:06.572409 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:06.573507 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:06.574120 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:06.574120 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:06.574120 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:06.591101 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:13:06.591101 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:06.591418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:06.591749 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:06.592160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:13:06.606770 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:06.607693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:06.608278 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:06.608545 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:06.609182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:06.609449 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:06.623910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:06.623910 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:06.624842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:06.624842 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9] added
May 13 02:13:06.639174 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:06.639174 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:06.639174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:06.639731 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:06.639931 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:06.641420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9] added
May 13 02:13:06.641420 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:06.641420 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:06.641420 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:06.641420 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:06.641420 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:06.641420 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:06.641615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:06.641731 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:06.641920 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:06.668358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:06.668530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:06.749431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:06.934895 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.935384 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.935704 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.936392 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.936877 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.937233 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.937430 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:06.937970 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:13:06.937970 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:13:07.173380 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Detaching volume d203859f-c3f2-4302-8fa3-f0dd316fdb0f
May 13 02:13:07.183386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:07.231843 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Attempting to driver detach volume d203859f-c3f2-4302-8fa3-f0dd316fdb0f from mountpoint /dev/vdb
May 13 02:13:07.242722 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found disk vdb by alias ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:13:07.247816 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Found disk vdb by alias ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:13:07.251406 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Attempting to detach device vdb from instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:13:07.251673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <alias name="ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f"/>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <serial>d203859f-c3f2-4302-8fa3-f0dd316fdb0f</serial>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]: </disk>
May 13 02:13:07.251673 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:13:07.260283 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully detached device vdb from instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 from the persistent domain config.
May 13 02:13:07.260498 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] (1/8): Attempting to detach device vdb with device alias ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f from instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:13:07.260834 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <alias name="ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f"/>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <serial>d203859f-c3f2-4302-8fa3-f0dd316fdb0f</serial>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]: </disk>
May 13 02:13:07.260834 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:13:07.433338 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:07.444850 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:07.445279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:07.445420 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:07.445736 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:13:07.643010 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:07.644383 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:07.664312 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:07.664312 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:07.677962 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:07.677962 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.689542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.699199 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.708595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.708595 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.708595 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.708595 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.708595 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:07.709169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.709169 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.709169 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.709169 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.709169 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:07.717213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.717213 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.717213 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.717213 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.717213 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:07.717571 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.717571 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.717571 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.717571 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.717571 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:07.750420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.40.100,3260]
May 13 02:13:07.750420 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.40.100,3260] successful.
May 13 02:13:07.750420 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.766797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.774874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.50.100,3260]
May 13 02:13:07.774874 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.50.100,3260] successful.
May 13 02:13:07.774874 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.790308 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.790574 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:07.790877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:07.791454 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:07.792267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('11', '-', '-', 0) found on session 117 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:07.792411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:07.794388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:07.819225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 117 and hctl ['11', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:07.829137 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('12', '-', '-', 0) found on session 118 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:07.829137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:07.854986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 118 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:07.855372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:07.968127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f for instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:13:07.969226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638387.968409, 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 => ua-d203859f-c3f2-4302-8fa3-f0dd316fdb0f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:13:07.978567 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully detached device vdb from instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 from the live domain config.
May 13 02:13:07.982717 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:13:07.983224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:07.983477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:08.497836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:08.631005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:08.631566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:08.735721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:08.740461 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:13:08.742426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:08.820397 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 117 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:08.820951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:08.854621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:08.855554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:08.972678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:08.977943 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:09.075623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:09.076412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:09.191169 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:09.197288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:09.338312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:09.339415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:09.461482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:09.467873 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:09.469888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:09.531735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:09.532215 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12424MB free_disk=72.91780090332031GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:13:09.532461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:09.533047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:09.633756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 330000000cd90376f for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:13:09.634340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:09.635548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.651s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:09.636053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:13:09.636566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:13:09.639898 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000cd90376f', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000cd90376f'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:09.639898 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cd90376f', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '330000000cd90376f'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:09.672461 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: tcp: [116] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:09.673479 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', '116'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '118')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:13:09.673479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', '115')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:09.675224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', '116')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:09.675224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c240680>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:13:09.675224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Removing multipathed devices sdd, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:13:09.677645 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Flush multipath device 330000000860e3ab2 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:13:09.704956 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1b968225-d390-4e02-9871-58d0713ff39b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'serial': 'c28090ee-099f-45a3-93b4-7a17b515cde9'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:13:09.705799 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:13:09.706082 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:13:09.706368 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:13:09.707453 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x705c8c2845c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1b968225-d390-4e02-9871-58d0713ff39b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'serial': 'c28090ee-099f-45a3-93b4-7a17b515cde9'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:13:09.707638 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98103) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 02:13:09.707793 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] opening encrypted volume /dev/dm-4 {{(pid=98103) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 02:13:09.718133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:13:09.766614 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.luks [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 02:13:09.767650 np0000000663 nova-compute[98103]: INFO os_brick.encryptors.luks [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] /dev/dm-4 is not a valid LUKS device; formatting device for first use
May 13 02:13:09.767650 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98103) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 02:13:09.769458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:13:09.827932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:13:09.828394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:13:09.829209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:13:09.851623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:13:09.851623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:13:09.866187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:09.901947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.40.100,3260]
May 13 02:13:09.901947 np0000000663 nova-compute[98103]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.40.100,3260] successful.
May 13 02:13:09.901947 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:09.926726 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:09.944186 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:09.986907 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.50.100,3260]
May 13 02:13:09.986907 np0000000663 nova-compute[98103]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, portal: 192.168.50.100,3260] successful.
May 13 02:13:09.986907 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:10.015715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:10.016009 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:10.016009 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== disconnect_volume: return (2032ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:10.016194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:13:10.055147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:10.055147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:10.564893 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:10.601846 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'flavor' on Instance uuid 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:10.633868 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 94b0397a-4725-422f-97f8-32d7b09d5c18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance acca535f-2ccf-44dc-b45b-1587bcc4561a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1b968225-d390-4e02-9871-58d0713ff39b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:13:10.637135 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:13:09 up 37 min,  2 users,  load average: 9.29, 7.90, 4.91\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_c97b10a192fd43f689e55b4537a4f824': '1', 'io_workload': '1', 'num_proj_635951473383437bbabc3b1bb776416a': '1', 'num_task_deleting': '1', 'num_proj_179ca7073b3146308156a52a09a12713': '1', 'num_proj_8b11777492cc476fb87a83ff007dc8b9': '1', 'num_proj_0787f738661944129f59b1250bc5e71e': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:13:10.701140 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:11.064197 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:11.064197 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:11.072832 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Ignoring supplied device name: /dev/vdb
May 13 02:13:11.571670 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:11.583633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.529s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:11.613337 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7afe2292-8a5f-4bab-904a-3b2343da728b tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.944s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:11.613905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.864s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:11.614240 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:11.614422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:11.614604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:11.619115 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Terminating instance
May 13 02:13:12.088457 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:13:12.088457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.553s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:12.088457 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.94 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:13:12.123447 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:13:12.150269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.154572 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.157788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.180571 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.189925 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.201007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.233585 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.235182 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:12.441411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:12.441411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:12.568325 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:12.568572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:12.573381 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:12.574001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:12.576807 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] No waiting events found dispatching network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:12.580123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-69010195-042e-4716-bed1-b767f55da059 req-e7f81380-c832-4d03-9bf3-9a0112ac2161 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:12.625413 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999619642000198 future=<Future at 0x705c48649ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:12.626040 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999208479000117 future=<Future at 0x705c48649ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:12.626040 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999055063000014 future=<Future at 0x705c48649ca0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:12.640556 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Instance destroyed successfully.
May 13 02:13:12.641705 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lazy-loading 'resources' on Instance uuid 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:12.755688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:12.755688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:12.756016 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Attaching volume ded2c38e-9a70-4c55-8b1d-a70f054f962a to /dev/vdb
May 13 02:13:12.864958 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:12.923846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:13:12.963120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:12.979641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:13.031787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:13:13.032936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:13:13.056334 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:13:13.059430 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe5d:c650', 'fe80::34d7:b7ff:fe3c:7526', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe77:231c', 'fe80::3484:12ff:fe29:39e5'] 
May 13 02:13:13.059586 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:13:13.059633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:13:13.061460 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:13.061460 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating existing volume attachment record: 859c0cc5-9c83-4f7e-9616-745aedd683ff {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:13:13.147130 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-333287025',display_name='tempest-VolumesSnapshotTestJSON-instance-333287025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumessnapshottestjson-instance-333287025',id=47,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiWkTE1vqR5X9jN386AT+/pXoPjrEfxH5dpBpfUAk/x+E1K9Z58XL8ku8kCz2FeCPI9Fi0N/bkXFxpaI+ksXGzjoiBiOP7PYd1QeqepCb9z/CMWY28wPp5cGLb+sLcMtA==',key_name='tempest-keypair-1518700007',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:12Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='179ca7073b3146308156a52a09a12713',ramdisk_id='',reservation_id='r-ku1pmc4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2040320791',owner_user_name='tempest-VolumesSnapshotTestJSON-2040320791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99b42dec2d7345d7a446924b3f75142e',uuid=1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:13:13.147130 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converting VIF {"id": "4b528d45-4efb-4bac-9669-689d24099f4a", "address": "fa:16:3e:7c:d1:6a", "network": {"id": "e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1036984187-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "179ca7073b3146308156a52a09a12713", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b528d45-4e", "ovs_interfaceid": "4b528d45-4efb-4bac-9669-689d24099f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:13.147130 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:13.148176 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:13:13.154792 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.155293 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b528d45-4e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:13.157111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.158473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:13.158917 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.160207 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.160398 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b01cc659-ca8f-4701-a4e7-6205242074ca) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:13.161488 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.162229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:13.165809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:13.172703 np0000000663 nova-compute[98103]: INFO os_vif [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:d1:6a,bridge_name='br-int',has_traffic_filtering=True,id=4b528d45-4efb-4bac-9669-689d24099f4a,network=Network(e51f1580-3cb7-4ccf-b1c6-0e5e2dc65ee2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b528d45-4e')
May 13 02:13:13.184386 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:13:13.185432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:13.186322 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:13.187139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:13.187850 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd203859f-c3f2-4302-8fa3-f0dd316fdb0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:13:13.188249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:13.246055 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '118')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d203859f-c3f2-4302-8fa3-f0dd316fdb0f') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48715a80>, {}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:13:13.246055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Disconnecting from: [] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:13:13.246984 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.059s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:13.246984 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] <== disconnect_volume: return (60ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:13.249618 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:13:13.249618 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Deleting instance files /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1_del
May 13 02:13:13.249618 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Deletion of /opt/stack/data/nova/instances/1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1_del complete
May 13 02:13:13.578904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:13.579423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:13.586004 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:13.586222 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Claim successful on node np0000000663
May 13 02:13:13.652628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:13:13.653063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:13.653660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:13.653854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:13.654032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:13:13.673397 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:13.674145 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:13.674942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:13.675574 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:13.676569 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:13.676569 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:13.691505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:13.691505 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:13.704979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:13.704979 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a] added
May 13 02:13:13.711828 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:13.711828 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:13.711828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:13.712234 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:13.712234 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:13.717987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a] added
May 13 02:13:13.717987 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:13.717987 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:13.717987 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:13.717987 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:13.717987 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:13.717987 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:13.718932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:13.718932 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0423(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:13.718932 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:13.763656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Took 1.64 seconds to destroy the instance on the hypervisor.
May 13 02:13:13.764454 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:13:13.764792 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:13:13.764952 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:13:13.765827 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:13.846266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:13.846266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:13.846266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:13.846266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:13.846266 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:13.854901 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Terminating instance
May 13 02:13:13.873063 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:14.363390 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:13:14.395786 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.401213 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.425964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.428568 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.461037 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.462402 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.703502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.713261 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:14.723208 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:14.742325 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:14.742325 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.746585 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:14.750736 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:14.755596 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997981939000056 future=<Future at 0x705c4872d820 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:14.756859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] Acquiring lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:14.756859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:14.756859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:14.757943 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] No waiting events found dispatching network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:14.757943 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-39bf57c3-460f-4795-bd13-82270c200108 req-89fd24c2-af86-4a52-92d2-f4e1687f8d97 service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-unplugged-4b528d45-4efb-4bac-9669-689d24099f4a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:14.758986 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:14.758986 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.762281 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Instance destroyed successfully.
May 13 02:13:14.764515 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lazy-loading 'resources' on Instance uuid 94b0397a-4725-422f-97f8-32d7b09d5c18 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:14.768465 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.784955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.788795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.788795 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.788795 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.788795 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.788795 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:14.789874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.789874 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.789874 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.789874 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.789874 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:14.805155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.805155 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.805155 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.805155 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.805155 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:14.805364 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.805364 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.805364 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.805364 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.805364 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:14.841124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.40.100,3260]
May 13 02:13:14.841124 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.40.100,3260] successful.
May 13 02:13:14.841124 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.857584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.866707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.50.100,3260]
May 13 02:13:14.866707 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.50.100,3260] successful.
May 13 02:13:14.866707 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.883458 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.885441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:14.885868 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:14.885990 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:14.886945 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] HCTL ('8', '-', '-', 0) found on session 119 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:14.890117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:14.890117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:14.914256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching for a device in session 119 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:14.914417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.915620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:14.915897 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:14.916159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:14.916377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:14.920416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] HCTL ('9', '-', '-', 0) found on session 120 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:14.920416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:14.945115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Searching for a device in session 120 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:14.946536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:15.157549 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:15.221139 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.232952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.238825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.246270 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.260771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:15.260771 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:15.268083 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-784631415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumeshelvetestjson-server-784631415',id=46,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoG38eRWKMTGsvpWosYiMin4smUcwcvBohNKwIWkgz90ZYwa4McR0N3k8G7cYX3YOxDixo3/iB71DluH6n0Nl7u031kYLRxzljgfyKObdoMrxQQ5w8sLr5p2ZFqhA3bvQ==',key_name='tempest-keypair-2087693019',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:36Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='635951473383437bbabc3b1bb776416a',ramdisk_id='',reservation_id='r-wphdap09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-970754436',owner_user_name='tempest-AttachVolumeShelveTestJSON-970754436-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2554c8defe944528a06bbfd6f360dcd4',uuid=94b0397a-4725-422f-97f8-32d7b09d5c18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:13:15.268411 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converting VIF {"id": "e5501dcb-7176-4b02-bf66-77b127e32767", "address": "fa:16:3e:5d:c6:50", "network": {"id": "6872ae26-0957-4b8c-bccf-23b50d4b65ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-287763618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "635951473383437bbabc3b1bb776416a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5501dcb-71", "ovs_interfaceid": "e5501dcb-7176-4b02-bf66-77b127e32767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:15.268888 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:15.269188 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:13:15.274054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.274848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5501dcb-71, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:15.276493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.276817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:15.279309 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.280410 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.280594 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a11e140-6b5b-4884-a769-1a1de1145871) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:15.283333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.283838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:15.287529 np0000000663 nova-compute[98103]: INFO os_vif [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c6:50,bridge_name='br-int',has_traffic_filtering=True,id=e5501dcb-7176-4b02-bf66-77b127e32767,network=Network(6872ae26-0957-4b8c-bccf-23b50d4b65ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5501dcb-71')
May 13 02:13:15.288155 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Deleting instance files /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18_del
May 13 02:13:15.299219 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Deletion of /opt/stack/data/nova/instances/94b0397a-4725-422f-97f8-32d7b09d5c18_del complete
May 13 02:13:15.371994 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.375077 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.398747 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.611395 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] opening encrypted volume /dev/dm-4 {{(pid=98103) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 02:13:15.663902 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Took 1.90 seconds to deallocate network for instance.
May 13 02:13:15.676496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:13:15.685217 np0000000663 nova-compute[98103]: WARNING nova.volume.cinder [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Attachment 0305f059-0530-4e96-b07f-a8ea8e3278d8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0305f059-0530-4e96-b07f-a8ea8e3278d8. (HTTP 404) (Request-ID: req-acf59bac-69b6-4582-a2ac-4f672b355a84)
May 13 02:13:15.685217 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Took 0.02 seconds to detach 1 volumes for instance.
May 13 02:13:15.703269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:15.763497 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:15.809030 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Took 1.45 seconds to destroy the instance on the hypervisor.
May 13 02:13:15.809717 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:13:15.809956 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:13:15.810060 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:13:15.810338 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:15.903023 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:16.192995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:16.272237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.693s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:16.272973 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:16.277588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.084s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:16.696877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found WWN 3300000006bdf66ae for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:13:16.696877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:16.696877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000006bdf66ae', 'path': '/dev/dm-0', 'multipath_id': '3300000006bdf66ae'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:16.696877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006bdf66ae', 'path': '/dev/dm-0', 'multipath_id': '3300000006bdf66ae'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:13:16.700928 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:16.783435 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:16.783730 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:16.784051 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:16.784396 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:16.800404 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:16.800824 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:16.852292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Received event network-vif-deleted-4b528d45-4efb-4bac-9669-689d24099f4a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:16.852602 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:16.852881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:16.853308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:16.853423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:16.853639 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:16.853801 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:16.853949 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:16.854235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Acquiring lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:16.854439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:16.854578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:16.854718 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] No waiting events found dispatching network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:16.854880 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-unplugged-e5501dcb-7176-4b02-bf66-77b127e32767 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:16.855017 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Received event network-vif-deleted-e5501dcb-7176-4b02-bf66-77b127e32767 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:16.855191 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Neutron deleted interface e5501dcb-7176-4b02-bf66-77b127e32767; detaching it from the instance and deleting it from the info cache
May 13 02:13:16.855429 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:16.874896 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ede91bfd8a22438dbe0124215f059630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '870689e5ef3f426395f7245076bf7085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:17.007875 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:17.206372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Attempting to attach volume ded2c38e-9a70-4c55-8b1d-a70f054f962a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:13:17.209551 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:   <alias name="ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a"/>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:   <serial>ded2c38e-9a70-4c55-8b1d-a70f054f962a</serial>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]: </disk>
May 13 02:13:17.209551 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:13:17.287866 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:17.304180 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:17.363887 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1cfb7321-bb98-4373-8eb3-66a30064e33e req-041d157f-6307-4d8d-8fce-cb6c635e199d service nova] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Detach interface failed, port_id=e5501dcb-7176-4b02-bf66-77b127e32767, reason: Instance 94b0397a-4725-422f-97f8-32d7b09d5c18 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:13:17.489728 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Successfully created port: 3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:17.510666 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Took 1.70 seconds to deallocate network for instance.
May 13 02:13:17.793739 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:17.814189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.538s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:17.889275 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Deleted allocations for instance 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1
May 13 02:13:17.969667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2099697253',display_name='tempest-TestVolumeBootPattern-server-2099697253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-2099697253',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-03e9dz79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:04Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=1b968225-d390-4e02-9871-58d0713ff39b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:17.970013 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:17.970557 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:17.971496 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b968225-d390-4e02-9871-58d0713ff39b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:18.017372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:18.017655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:18.102379 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Successfully updated port: 3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:18.146159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.160649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-changed-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:18.160883 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Refreshing instance network info cache due to event network-changed-3eb00744-546e-4637-b559-990890f2b11f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:18.161420 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] Acquiring lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:18.161554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] Acquired lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:18.161715 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Refreshing network info cache for port 3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:18.364530 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:18.364811 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <uuid>1b968225-d390-4e02-9871-58d0713ff39b</uuid>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <name>instance-00000034</name>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-2099697253</nova:name>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:06</nova:creationTime>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         <nova:port uuid="9b08e0f3-b210-4de9-91f8-a9edbb687f26">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="serial">1b968225-d390-4e02-9871-58d0713ff39b</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="uuid">1b968225-d390-4e02-9871-58d0713ff39b</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/disk.config"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <alias name="ua-c28090ee-099f-45a3-93b4-7a17b515cde9"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <serial>c28090ee-099f-45a3-93b4-7a17b515cde9</serial>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:b8:b8:e4"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <target dev="tap9b08e0f3-b2"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/console.log" append="off"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:18.477131 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Preparing to wait for external event network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:18.477131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:18.482440 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2099697253',display_name='tempest-TestVolumeBootPattern-server-2099697253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-2099697253',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-03e9dz79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:04Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=1b968225-d390-4e02-9871-58d0713ff39b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:18.482440 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:18.482440 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:18.482440 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:18.482944 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.483221 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:18.483479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:18.484619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.484619 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdf8ee85-4b84-5359-8cca-3e778e52f98c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:18.485007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.485881 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:18.486363 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.490197 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.490444 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b08e0f3-b2, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:18.490803 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b08e0f3-b2, col_values=(('qos', UUID('308efcf0-82b3-49ab-9164-9a63317c1260')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:18.491019 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b08e0f3-b2, col_values=(('external_ids', {'iface-id': '9b08e0f3-b210-4de9-91f8-a9edbb687f26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:b8:e4', 'vm-uuid': '1b968225-d390-4e02-9871-58d0713ff39b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:18.493230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.493230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:18.498277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:18.500463 np0000000663 nova-compute[98103]: INFO os_vif [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2')
May 13 02:13:18.607425 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:18.664397 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:18.742340 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:18.804919 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:18.806116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:18.806433 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Creating image(s)
May 13 02:13:18.807249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:18.807395 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:18.807944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:18.808886 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:18.813291 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:18.816319 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:18.869112 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:18.884994 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:18.885134 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:18.885252 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:18.885396 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No VIF found with MAC fa:16:3e:f8:7a:ec, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:18.906062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61c7dc87-c2a7-45a8-9e4e-0c759665fc51 tempest-VolumesSnapshotTestJSON-2040320791 tempest-VolumesSnapshotTestJSON-2040320791-project-member] Lock "1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.293s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:18.939343 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:18.941987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:18.942397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:18.943301 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:18.943810 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:18.949886 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:18.951988 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:19.070506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:19.071106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:19.138710 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk 1073741824" returned: 0 in 0.067s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:19.140181 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:19.140580 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:19.249261 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:19.250989 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:13:19.250989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:19.350941 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:19.352247 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Cannot resize image /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:13:19.352419 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:13:19.352678 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Ensure instance console log exists: /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:19.353031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:19.353405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:19.353607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:19.385276 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.367s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:19.443788 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1d62f60e-59d6-4769-bed6-7adef002c7da req-ab8847e7-c5a5-4313-bfda-02cc05c1f07a service nova] Releasing lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:19.444630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquired lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:19.445068 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:19.460209 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Deleted allocations for instance 94b0397a-4725-422f-97f8-32d7b09d5c18
May 13 02:13:20.032607 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:20.035569 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:20.035711 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:20.036164 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:b8:b8:e4, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:20.036637 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Using config drive
May 13 02:13:20.259507 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:20.412728 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating instance_info_cache with network_info: [{"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:20.472279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-05ff89ea-a6d9-4778-a9bc-5889dc8a2c36 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.717s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:20.473035 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-132f8ace-66d0-4846-b08f-07dbb546ae06 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Lock "94b0397a-4725-422f-97f8-32d7b09d5c18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.630s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:20.543917 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:20.702711 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:20.717795 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Creating config drive at /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/disk.config
May 13 02:13:20.720974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ei219ci {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:20.779410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0ei219ci" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:20.914971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Releasing lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:20.915585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance network_info: |[{"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:20.917732 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Start _get_guest_xml network_info=[{"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:20.928913 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:20.930630 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-648343419', uuid='96973110-5b6f-4469-8513-47e1f791fa60'), owner=OwnerMeta(userid='ede91bfd8a22438dbe0124215f059630', username='tempest-SnapshotDataIntegrityTests-2139004155-project-member', projectid='870689e5ef3f426395f7245076bf7085', projectname='tempest-SnapshotDataIntegrityTests-2139004155'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638400.9302144) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:20.934640 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:20.935064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:20.937039 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:20.937235 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:20.939001 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:20.939440 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:20.939652 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:20.939814 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:20.940000 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:20.940270 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:20.940424 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:20.940615 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:20.940756 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:20.940871 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:20.940982 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:20.941113 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:20.952128 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-648343419',display_name='tempest-SnapshotDataIntegrityTests-server-648343419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-snapshotdataintegritytests-server-648343419',id=53,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX0dJweJtTHRVvDEfD3Ct4rtQUbnVYLpccTZMY7IUZV2/r3hH4WcEJ1Uq3rmR1Qly7ig4H0rpK/erSpwNf5HJ1ISFkXcxZGqCcyTMk/Ga4qg2LZuKrKMb+jmLyqjV71tg==',key_name='tempest-keypair-906370292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='870689e5ef3f426395f7245076bf7085',ramdisk_id='',reservation_id='r-k02amlg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2139004155',owner_user_name='tempest-SnapshotDataIntegrityTests-2139004155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ede91bfd8a22438dbe0124215f059630',uuid=96973110-5b6f-4469-8513-47e1f791fa60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:20.952548 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converting VIF {"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:20.953230 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:20.953791 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'pci_devices' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:21.278263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.317491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.417440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <uuid>96973110-5b6f-4469-8513-47e1f791fa60</uuid>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <name>instance-00000035</name>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-648343419</nova:name>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:20</nova:creationTime>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:user uuid="ede91bfd8a22438dbe0124215f059630">tempest-SnapshotDataIntegrityTests-2139004155-project-member</nova:user>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:project uuid="870689e5ef3f426395f7245076bf7085">tempest-SnapshotDataIntegrityTests-2139004155</nova:project>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         <nova:port uuid="3eb00744-546e-4637-b559-990890f2b11f">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="serial">96973110-5b6f-4469-8513-47e1f791fa60</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="uuid">96973110-5b6f-4469-8513-47e1f791fa60</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.config"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:58:af:b7"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <target dev="tap3eb00744-54"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/console.log" append="off"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:21.461245 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Preparing to wait for external event network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-648343419',display_name='tempest-SnapshotDataIntegrityTests-server-648343419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-snapshotdataintegritytests-server-648343419',id=53,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX0dJweJtTHRVvDEfD3Ct4rtQUbnVYLpccTZMY7IUZV2/r3hH4WcEJ1Uq3rmR1Qly7ig4H0rpK/erSpwNf5HJ1ISFkXcxZGqCcyTMk/Ga4qg2LZuKrKMb+jmLyqjV71tg==',key_name='tempest-keypair-906370292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='870689e5ef3f426395f7245076bf7085',ramdisk_id='',reservation_id='r-k02amlg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2139004155',owner_user_name='tempest-SnapshotDataIntegrityTests-2139004155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ede91bfd8a22438dbe0124215f059630',uuid=96973110-5b6f-4469-8513-47e1f791fa60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:21.461245 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converting VIF {"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:21.466073 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:21.467771 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:21.469142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.469142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:21.469142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:21.470707 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.470707 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c773cf44-9f20-5c11-bf9e-29ea3abd3812', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:21.473412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.473412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:21.473412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.477437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.477635 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb00744-54, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:21.478159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eb00744-54, col_values=(('qos', UUID('145803d4-af74-41fa-ba7b-40d750333281')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:21.478443 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eb00744-54, col_values=(('external_ids', {'iface-id': '3eb00744-546e-4637-b559-990890f2b11f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:af:b7', 'vm-uuid': '96973110-5b6f-4469-8513-47e1f791fa60'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:21.479561 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.481128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:21.487330 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.488116 np0000000663 nova-compute[98103]: INFO os_vif [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54')
May 13 02:13:21.652981 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ae5bbd8a-cf8f-4b95-820f-fb0675346bc9 req-11bf4c48-f5bc-4a86-b39c-b5223eb95113 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:21.653271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae5bbd8a-cf8f-4b95-820f-fb0675346bc9 req-11bf4c48-f5bc-4a86-b39c-b5223eb95113 service nova] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:21.654049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae5bbd8a-cf8f-4b95-820f-fb0675346bc9 req-11bf4c48-f5bc-4a86-b39c-b5223eb95113 service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:21.654244 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ae5bbd8a-cf8f-4b95-820f-fb0675346bc9 req-11bf4c48-f5bc-4a86-b39c-b5223eb95113 service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:21.654600 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ae5bbd8a-cf8f-4b95-820f-fb0675346bc9 req-11bf4c48-f5bc-4a86-b39c-b5223eb95113 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Processing event network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:13:21.661297 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.669831 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.672448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.701855 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:21.707299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:22.308475 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638402.3080618, 1b968225-d390-4e02-9871-58d0713ff39b => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:22.311707 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] VM Started (Lifecycle Event)
May 13 02:13:22.313035 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:13:22.316950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:13:22.320581 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance spawned successfully.
May 13 02:13:22.320887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:13:22.814229 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:22.816186 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:22.830842 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:22.831028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:22.831291 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:22.831566 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:22.831911 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:22.832461 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:23.015335 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:23.015518 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:23.015652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No VIF found with MAC fa:16:3e:58:af:b7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:23.016187 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Using config drive
May 13 02:13:23.318312 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:13:23.318751 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638403.3184023, 1b968225-d390-4e02-9871-58d0713ff39b => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:23.318751 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] VM Paused (Lifecycle Event)
May 13 02:13:23.338357 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Took 16.81 seconds to spawn the instance on the hypervisor.
May 13 02:13:23.338551 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:23.522367 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:23.713998 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Creating config drive at /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.config
May 13 02:13:23.720932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp795wc9vb {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:23.750065 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:23.750956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:23.751336 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:23.751569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:23.751799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] No waiting events found dispatching network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:23.751980 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-97c17226-7aaf-41a4-abdf-24c9e60ea32c req-367d8e20-c66d-4a07-a89c-6da3a851e0bd service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received unexpected event network-vif-plugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 for instance with vm_state active and task_state None.
May 13 02:13:23.775818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp795wc9vb" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:23.821548 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:23.828750 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638403.8284369, 1b968225-d390-4e02-9871-58d0713ff39b => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:23.829357 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] VM Resumed (Lifecycle Event)
May 13 02:13:23.858220 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Took 24.03 seconds to build instance.
May 13 02:13:24.305280 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:24.334140 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:24.339064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:24.345772 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:24.359709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.544s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:24.450919 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:24.722272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:24.758594 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:25.472631 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638405.472244, 96973110-5b6f-4469-8513-47e1f791fa60 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:25.474182 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] VM Started (Lifecycle Event)
May 13 02:13:25.713155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:25.820675 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:25.820823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:25.821344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:25.821344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:25.822433 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Processing event network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:13:25.823334 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:25.823899 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:13:25.824406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:25.824643 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:25.824849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:25.825038 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] No waiting events found dispatching network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:25.825238 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-55538ce6-c816-4046-b3f6-9ac94bc2b187 req-ab3b2bfa-59db-4d1c-a786-34fe4afa2000 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received unexpected event network-vif-plugged-3eb00744-546e-4637-b559-990890f2b11f for instance with vm_state building and task_state spawning.
May 13 02:13:25.830246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:13:25.840006 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance spawned successfully.
May 13 02:13:25.840501 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:13:25.977053 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:25.980147 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:26.009381 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:26.009629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:26.009859 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:26.010046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:26.010206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:26.012697 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Terminating instance
May 13 02:13:26.215962 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.349813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.349985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.350499 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.350874 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.351276 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.352258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:26.484220 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:13:26.484220 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638406.4831345, 96973110-5b6f-4469-8513-47e1f791fa60 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:26.484220 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] VM Paused (Lifecycle Event)
May 13 02:13:26.485302 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.516239 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:13:26.544906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.550676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.571590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.579287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.606878 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.609229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:26.865542 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Took 8.06 seconds to spawn the instance on the hypervisor.
May 13 02:13:26.865755 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:26.878139 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Instance destroyed successfully.
May 13 02:13:26.882952 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 1b968225-d390-4e02-9871-58d0713ff39b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:26.988192 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:26.993291 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638406.9930074, 96973110-5b6f-4469-8513-47e1f791fa60 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:26.993412 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] VM Resumed (Lifecycle Event)
May 13 02:13:27.387340 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2099697253',display_name='tempest-TestVolumeBootPattern-server-2099697253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-2099697253',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:13:23Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-03e9dz79',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:13:23Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=1b968225-d390-4e02-9871-58d0713ff39b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:13:27.387584 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "address": "fa:16:3e:b8:b8:e4", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b08e0f3-b2", "ovs_interfaceid": "9b08e0f3-b210-4de9-91f8-a9edbb687f26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:27.388959 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:27.389373 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:13:27.393111 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Took 13.91 seconds to build instance.
May 13 02:13:27.393901 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:27.394328 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b08e0f3-b2, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:27.395700 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:27.396656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:27.396918 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:27.398051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:27.398051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=308efcf0-82b3-49ab-9164-9a63317c1260) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:27.400151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:27.400787 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:27.402930 np0000000663 nova-compute[98103]: INFO os_vif [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:b8:e4,bridge_name='br-int',has_traffic_filtering=True,id=9b08e0f3-b210-4de9-91f8-a9edbb687f26,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b08e0f3-b2')
May 13 02:13:27.447965 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1b968225-d390-4e02-9871-58d0713ff39b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'serial': 'c28090ee-099f-45a3-93b4-7a17b515cde9'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:13:27.448620 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:13:27.448867 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:13:27.449016 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:13:27.449547 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x705c8810f140>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '1b968225-d390-4e02-9871-58d0713ff39b', 'attached_at': '', 'detached_at': '', 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'serial': 'c28090ee-099f-45a3-93b4-7a17b515cde9'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:13:27.449703 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] closing encrypted volume /dev/dm-5 {{(pid=98103) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 13 02:13:27.484435 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:13:27.485563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:27.485563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:27.485932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:27.488775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c28090ee-099f-45a3-93b4-7a17b515cde9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:13:27.490200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:13:27.496265 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:27.499450 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10679889-c85f-4cbd-8564-f6133641d10c (non-flash)
May 13 02:13:27.527288 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9 (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10679889-c85f-4cbd-8564-f6133641d10c (non-flash)
May 13 02:13:27.528319 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10679889-c85f-4cbd-8564-f6133641d10c', '121')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:13:27.528319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '117')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:27.529080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9', '118')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:13:27.530023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c4878f920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:13:27.530856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:13:27.530856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 330000000cd90376f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:13:27.575682 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:13:27.625689 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0006528720000460453 future=<Future at 0x705c48649ca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:27.625840 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:27.626507 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=2.1275554489998285 future=<Future at 0x705c4872d820 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:27.626507 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=2.127467945999797 future=<Future at 0x705c4872d820 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:27.626507 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Emitting event <LifecycleEvent: 1778638392.6249218, 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:27.626682 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] VM Stopped (Lifecycle Event)
May 13 02:13:27.628854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:13:27.677342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:13:27.677536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:13:27.679263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:13:27.690047 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:13:27.690520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:13:27.703767 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.740302 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.40.100,3260]
May 13 02:13:27.740302 np0000000663 nova-compute[98103]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.40.100,3260] successful.
May 13 02:13:27.740302 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.768507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.785162 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.826400 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.50.100,3260]
May 13 02:13:27.826400 np0000000663 nova-compute[98103]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-c28090ee-099f-45a3-93b4-7a17b515cde9, portal: 192.168.50.100,3260] successful.
May 13 02:13:27.826400 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.842768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:27.843858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:27.844001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (358ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:27.844184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:13:27.844621 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Deleting instance files /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b_del
May 13 02:13:27.845236 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Deletion of /opt/stack/data/nova/instances/1b968225-d390-4e02-9871-58d0713ff39b_del complete
May 13 02:13:27.897139 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.456s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:27.903483 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:27.907495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:27.907718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:27.907930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:27.908181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] No waiting events found dispatching network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:27.908233 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:27.908375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:27.908585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Acquiring lock "1b968225-d390-4e02-9871-58d0713ff39b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:27.908683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:27.908860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] Lock "1b968225-d390-4e02-9871-58d0713ff39b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:27.908999 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] No waiting events found dispatching network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:27.909169 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef152858-da45-452b-a4ff-b41b5d179f1a req-22368c53-77be-4d22-834c-1fbe4097933b service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-unplugged-9b08e0f3-b210-4de9-91f8-a9edbb687f26 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:28.004118 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999734597000042 future=<Future at 0x705c6c2b83b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:28.130637 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-489a7cba-0395-4f19-b1a6-dca43091cf87 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 1d683dbd-f265-4c8b-8a46-bc0d09a6d9a1] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:28.352536 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Took 1.84 seconds to destroy the instance on the hypervisor.
May 13 02:13:28.353229 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:13:28.353313 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:13:28.353410 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:13:28.353997 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:28.416306 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:28.866472 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4dae34df-7903-4664-98af-6f4637c3030b req-5bbdd23f-4105-428e-bb69-76f37eae9ac0 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Received event network-vif-deleted-9b08e0f3-b210-4de9-91f8-a9edbb687f26 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:28.867036 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-4dae34df-7903-4664-98af-6f4637c3030b req-5bbdd23f-4105-428e-bb69-76f37eae9ac0 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Neutron deleted interface 9b08e0f3-b210-4de9-91f8-a9edbb687f26; detaching it from the instance and deleting it from the info cache
May 13 02:13:28.867036 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4dae34df-7903-4664-98af-6f4637c3030b req-5bbdd23f-4105-428e-bb69-76f37eae9ac0 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:29.291366 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:29.371965 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4dae34df-7903-4664-98af-6f4637c3030b req-5bbdd23f-4105-428e-bb69-76f37eae9ac0 service nova] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Detach interface failed, port_id=9b08e0f3-b210-4de9-91f8-a9edbb687f26, reason: Instance 1b968225-d390-4e02-9871-58d0713ff39b could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:13:29.754932 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.001366003999919485 future=<Future at 0x705c4872d820 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:29.755603 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638394.7534626, 94b0397a-4725-422f-97f8-32d7b09d5c18 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:29.755860 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:29.756266 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] VM Stopped (Lifecycle Event)
May 13 02:13:29.757278 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.24653403100001 future=<Future at 0x705c6c2b83b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:29.757660 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.246134517999963 future=<Future at 0x705c6c2b83b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:29.793571 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Took 1.44 seconds to deallocate network for instance.
May 13 02:13:29.973160 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-changed-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:29.973669 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Refreshing instance network info cache due to event network-changed-3eb00744-546e-4637-b559-990890f2b11f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:29.973669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] Acquiring lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:29.973669 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] Acquired lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:29.973669 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Refreshing network info cache for port 3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:30.259016 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e8777e43-9627-442f-994c-3c2522b877a8 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 94b0397a-4725-422f-97f8-32d7b09d5c18] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:30.344962 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Took 0.55 seconds to detach 1 volumes for instance.
May 13 02:13:30.479534 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:30.715639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:30.851232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:30.851406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:30.954313 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:31.150436 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updated VIF entry in instance network info cache for port 3eb00744-546e-4637-b559-990890f2b11f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:13:31.150875 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating instance_info_cache with network_info: [{"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:31.171990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:31.172802 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:31.653760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8ff5ad0-fe36-401d-9e8b-51a7c01c694d req-2d132b0c-6046-4962-8804-38b2f460ce3d service nova] Releasing lock "refresh_cache-96973110-5b6f-4469-8513-47e1f791fa60" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:31.676685 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:32.046906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:32.188680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.337s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:32.271459 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 1b968225-d390-4e02-9871-58d0713ff39b
May 13 02:13:32.401908 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:32.889111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:32.889111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:32.889111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:32.889111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:32.889111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:32.894877 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Terminating instance
May 13 02:13:33.286006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d0902e5-ea51-4bdf-afb0-492313d719eb tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "1b968225-d390-4e02-9871-58d0713ff39b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.275s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:33.403325 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:13:33.421916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.432254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.455043 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.458883 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.490894 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.717809 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:33.718216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:33.718216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:33.718345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:33.718511 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:33.718681 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0b3deeb1-fd20-4482-b089-8289f15c53d8 req-81e2af37-423e-4164-9f8d-ca7be301e13f service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:33.731273 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.743905 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:33.772530 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999715961999755 future=<Future at 0x705c6c6dd4f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:33.774594 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Instance destroyed successfully.
May 13 02:13:33.776664 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'resources' on Instance uuid 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:34.061584 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:34.279735 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:10:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-101663398',display_name='tempest-AttachVolumeTestJSON-server-101663398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-101663398',id=45,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGEeKZFib8RTCDOIg5/Z3j3X4byfygploZ8QrRBCVk38iYizDR2RZeV+PzUAL3TMwULaBj8EurWe+eqRUAD6TROHMGxbEj9FHCO3JSe2/wcmz8xmVI8WEehQObpqdK9Wg==',key_name='tempest-keypair-26336240',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:10:53Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-9yeuqodl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:13:34.279996 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "address": "fa:16:3e:77:23:1c", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28c5c508-74", "ovs_interfaceid": "28c5c508-74e7-4622-8bbe-b35276f1e65c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:34.280746 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:34.280865 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:13:34.282746 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:34.283498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28c5c508-74, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:34.285691 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:34.290795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:34.291889 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:34.291889 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd66527d-f94b-46ea-8c2f-0f23cd91b4e4) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:34.293485 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:34.294380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:34.298680 np0000000663 nova-compute[98103]: INFO os_vif [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:23:1c,bridge_name='br-int',has_traffic_filtering=True,id=28c5c508-74e7-4622-8bbe-b35276f1e65c,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28c5c508-74')
May 13 02:13:34.299645 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Deleting instance files /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9_del
May 13 02:13:34.306460 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Deletion of /opt/stack/data/nova/instances/0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9_del complete
May 13 02:13:34.818482 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 02:13:34.819599 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:13:34.819904 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:13:34.820010 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:13:34.820249 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:34.956142 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:35.717506 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:35.791916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:35.792136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] Acquiring lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:35.792806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:35.792806 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:35.792806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] No waiting events found dispatching network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:35.792806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-unplugged-28c5c508-74e7-4622-8bbe-b35276f1e65c for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:13:35.792806 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Received event network-vif-deleted-28c5c508-74e7-4622-8bbe-b35276f1e65c {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:35.792947 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Neutron deleted interface 28c5c508-74e7-4622-8bbe-b35276f1e65c; detaching it from the instance and deleting it from the info cache
May 13 02:13:35.793107 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:36.080966 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:36.299687 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd1be2d8-7ed1-494e-b36d-6095a4a3b880 req-604d0670-f85f-45a4-acec-459f8707183e service nova] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Detach interface failed, port_id=28c5c508-74e7-4622-8bbe-b35276f1e65c, reason: Instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:13:36.583957 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Took 1.76 seconds to deallocate network for instance.
May 13 02:13:37.094621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:37.094621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:37.393168 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:37.436855 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:37.437677 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:37.791132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:37.941127 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:38.450192 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.356s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:38.535634 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Deleted allocations for instance 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9
May 13 02:13:39.162745 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:39.162745 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:39.304364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:39.547658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-73131b7c-da20-430a-acce-7999db1fc907 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.659s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:39.669522 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:39.686061 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:40.248661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:40.248976 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:40.252717 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:40.252934 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Claim successful on node np0000000663
May 13 02:13:40.721207 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:40.950612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:40.950858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:41.456172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:41.587118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:41.587277 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:42.031017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:42.090991 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:42.602342 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.353s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:42.602613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.571s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:42.602879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:42.604255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:42.611060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:42.611307 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Claim successful on node np0000000663
May 13 02:13:43.006941 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0028510710003502027 future=<Future at 0x705c6c2b83b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:43.006941 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:43.007133 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.764732095999989 future=<Future at 0x705c6c6dd4f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:43.007133 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=5.764621480999722 future=<Future at 0x705c6c6dd4f0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:43.007424 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Emitting event <LifecycleEvent: 1778638408.0037065, 1b968225-d390-4e02-9871-58d0713ff39b => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:43.007592 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] VM Stopped (Lifecycle Event)
May 13 02:13:43.124742 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:43.124742 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:43.125260 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:43.125368 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:43.217300 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:43.518338 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bf371b1b-ff40-40c5-bf36-4eaa8ac697e4 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 1b968225-d390-4e02-9871-58d0713ff39b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:43.631546 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:43.669537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:43.669815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:44.085366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:44.085366 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:44.138497 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:44.176197 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:44.272558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:44.273215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:44.305716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:44.334074 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Successfully created port: df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:44.588047 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:44.646958 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Booting with volume ccac6f30-47c4-4bca-9425-b817263826b4 at /dev/vda
May 13 02:13:44.718451 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:44.740722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:13:44.749117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:44.774718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:44.797313 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:44.836210 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:13:44.837773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:13:44.840142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:44.857381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:13:44.858799 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3'] 
May 13 02:13:44.858963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:13:44.859053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:13:44.859327 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:44.859519 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating existing volume attachment record: 5c7cfe0a-c5a2-4d1e-bb88-61884e865003 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:13:45.101177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.499s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:45.101726 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:45.104843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.353s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:45.110322 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:45.110467 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Claim successful on node np0000000663
May 13 02:13:45.224391 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Successfully updated port: df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:45.295499 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-changed-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:45.295664 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Refreshing instance network info cache due to event network-changed-df923fe3-7d23-4205-9a8c-6b4bc62da7eb. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:45.295917 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] Acquiring lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:45.296009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] Acquired lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:45.296145 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Refreshing network info cache for port df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:45.388402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:45.620551 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:45.621265 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:45.621362 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:45.622973 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:45.725261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:45.731650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:45.748992 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8648b9097814fd5848d1e51cbecf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0787f738661944129f59b1250bc5e71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:45.802087 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:45.877593 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:46.117868 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:46.133332 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:46.621531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c799ba51-90b6-406b-9498-a6b79156caf7 req-467c3ae8-e9e7-4f01-98b9-cddee1dd73c0 service nova] Releasing lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:46.622027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:46.622214 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:46.639110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:46.659483 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:46.659483 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:47.033278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:47.034645 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:47.034920 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Creating image(s)
May 13 02:13:47.035390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:13:47.035571 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Ensure instance console log exists: /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:47.035781 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:47.035940 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:47.036118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:47.084374 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Successfully created port: 3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:47.146387 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Booting with volume 6222d865-5c52-4e13-9ce0-c9adfa067fb4 at /dev/vda
May 13 02:13:47.162249 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:47.205778 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:47.219440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:13:47.247953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:47.277130 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:47.297390 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:13:47.298317 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:13:47.310842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:13:47.311758 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3'] 
May 13 02:13:47.311886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:13:47.312225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:13:47.312365 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:47.312570 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updating existing volume attachment record: 17f7f4d5-5b50-4f67-bbf9-e0ecfe21d1b9 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:13:47.401068 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:47.402177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:47.402177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:47.402177 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:47.402177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] No waiting events found dispatching network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:47.402468 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e5b40d34-f538-447d-a343-a2b31872262c req-2a2e3009-c591-4807-88d6-9063a59d95dc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received unexpected event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb for instance with vm_state building and task_state spawning.
May 13 02:13:47.575940 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:47.667077 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Successfully updated port: 3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:47.671250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.569s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:47.671807 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:47.679718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.291s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:47.693340 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:47.694405 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Claim successful on node np0000000663
May 13 02:13:47.732599 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-changed-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:47.733197 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Refreshing instance network info cache due to event network-changed-3de05011-8c4a-4392-9c34-dc3b51e22887. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:47.733405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] Acquiring lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:47.733543 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] Acquired lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:47.733710 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Refreshing network info cache for port 3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:47.770686 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating instance_info_cache with network_info: [{"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:48.185052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:48.186180 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:48.186324 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:48.186563 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:48.186795 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:48.236663 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:48.276055 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:48.276338 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance network_info: |[{"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:48.289582 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Start _get_guest_xml network_info=[{"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'cf28a209-585f-43b9-9612-cc47883cdadc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'serial': 'ccac6f30-47c4-4bca-9425-b817263826b4'}, 'attachment_id': '5c7cfe0a-c5a2-4d1e-bb88-61884e865003', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:48.297128 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:48.297882 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1313943128', uuid='cf28a209-585f-43b9-9612-cc47883cdadc'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638428.2975547) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:48.302535 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:48.302918 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:48.310372 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63c9dc09e45e4cdeb438d163532a8849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4cdaf6da19497586ec83765be014b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:48.312401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:48.312948 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:48.314781 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:48.315298 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:48.315531 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:48.315758 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:48.315870 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:48.315970 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:48.317125 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:48.332343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:13:48.332753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:48.332943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:48.333407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:48.333685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:13:48.351289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:48.352115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:48.352659 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:48.352903 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:48.353383 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:48.355196 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:48.361419 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:48.367166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:48.370706 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:48.370706 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:48.374558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:48.374558 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:48.393855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4] added
May 13 02:13:48.393855 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:48.393855 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:48.393855 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:48.393855 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:48.393855 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:48.393855 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:48.394544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:48.394544 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:48.394609 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4] added
May 13 02:13:48.396483 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:48.396483 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0424(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:48.396483 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:48.530065 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:48.686024 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:48.772508 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0006072160003895988 future=<Future at 0x705c6c6dd4f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:48.772508 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:13:48.773079 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Emitting event <LifecycleEvent: 1778638413.771651, 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:48.775068 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] VM Stopped (Lifecycle Event)
May 13 02:13:48.949138 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Successfully created port: ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:49.032157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-615daf46-4e2f-44df-a326-8aa9a240dc1a req-74fa55e0-b0a6-44cf-a614-dab8fb112fbb service nova] Releasing lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:49.033002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquired lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:49.033236 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:49.160928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:49.161283 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:49.189308 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:49.275904 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 0fe6bf31-1eb9-41dc-bff1-642ae0d5dae9] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:49.307723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:49.395388 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:49.396987 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:49.410218 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:49.410218 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:49.417973 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:49.417973 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.424400 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.430346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.437126 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:49.441156 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:49.442104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:49.442357 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Creating image(s)
May 13 02:13:49.442630 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:13:49.442763 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Ensure instance console log exists: /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:49.442969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:49.443176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:49.443350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:49.445909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.445909 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.445909 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.445909 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.445909 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:49.446182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.446182 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.446182 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.446182 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.446182 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:49.470316 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.40.100,3260]
May 13 02:13:49.470316 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.40.100,3260] successful.
May 13 02:13:49.470316 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.484343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.492169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.50.100,3260]
May 13 02:13:49.492169 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.50.100,3260] successful.
May 13 02:13:49.492169 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.502996 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.503345 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:49.503544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:49.503712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:49.504871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('11', '-', '-', 0) found on session 123 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:49.504871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:49.510734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:49.524578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 123 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:49.524578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.530053 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:49.530810 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:49.530810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:49.532153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('12', '-', '-', 0) found on session 124 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:49.532153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:49.536591 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Successfully updated port: ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:49.548336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 124 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:49.548336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:49.624127 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:49.664180 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:49.807340 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-changed-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:49.807902 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Refreshing instance network info cache due to event network-changed-ea775620-9d16-43bb-9d8e-7d8e589b9a29. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:49.807902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] Acquiring lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:49.807902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] Acquired lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:49.808171 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Refreshing network info cache for port ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:49.837179 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:49.968246 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updating instance_info_cache with network_info: [{"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:50.041123 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:50.175412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.496s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:50.175699 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:50.203374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:50.204284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:50.204522 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Creating image(s)
May 13 02:13:50.205032 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:50.205213 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:50.205645 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:50.206324 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:50.209155 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:50.209914 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:50.304609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:50.305554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:50.305856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:50.306427 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:50.309266 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:50.309653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:50.310700 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:50.355856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:13:50.401401 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:50.412297 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:50.412912 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:50.472002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Releasing lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:50.472695 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance network_info: |[{"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:50.474264 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Start _get_guest_xml network_info=[{"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fd054b4f-181b-44ac-8e14-86ea3659208c', 'attached_at': '', 'detached_at': '', 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'serial': '6222d865-5c52-4e13-9ce0-c9adfa067fb4'}, 'attachment_id': '17f7f4d5-5b50-4f67-bbf9-e0ecfe21d1b9', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:50.475403 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk 1073741824" returned: 0 in 0.062s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:50.476058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.170s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:50.476598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:50.506802 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:50.511118 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-627379103', uuid='fd054b4f-181b-44ac-8e14-86ea3659208c'), owner=OwnerMeta(userid='b8648b9097814fd5848d1e51cbecf9a6', username='tempest-TestVolumeBootPatternV346-1111989009-project-member', projectid='0787f738661944129f59b1250bc5e71e', projectname='tempest-TestVolumeBootPatternV346-1111989009'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638430.5094955) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:50.514104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:50.514104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:50.515229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:50.515449 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:50.516984 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:50.517561 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:50.517788 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:50.517960 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:50.518195 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:50.518354 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:50.518584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:50.519901 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:50.519901 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:50.520731 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:50.520731 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:50.521036 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:50.534372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:13:50.534906 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:13:50.535024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:50.592895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:50.593299 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:13:50.593530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:50.636110 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:50.684614 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:50.685032 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:50.685484 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:50.685935 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:50.699268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:50.699706 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Cannot resize image /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:13:50.700080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:13:50.700306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Ensure instance console log exists: /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:50.700627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:50.700916 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:50.701100 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:50.724733 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:50.810712 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b3cc512843b427fa59414fdf92f5e76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c97b10a192fd43f689e55b4537a4f824', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:50.971720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:51.139586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84e935da-0601-45ef-a2ad-25261745733b req-cec41258-579e-4a89-ab8f-f71fef91a0f4 service nova] Releasing lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:51.140107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquired lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:51.140311 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:51.184161 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:51.293554 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Successfully created port: f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:51.372820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 33000000082533193 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:13:51.373214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:51.373427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000082533193', 'path': '/dev/dm-4', 'multipath_id': '33000000082533193'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:51.373527 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000082533193', 'path': '/dev/dm-4', 'multipath_id': '33000000082533193'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:13:51.374183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.839s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:51.374458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:13:51.390786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:51.391691 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:13:51.392021 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:51.392249 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:51.392834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:13:51.393497 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:51.407884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:51.407884 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:51.414024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:13:51.414024 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:51.425842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4] added
May 13 02:13:51.425842 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:51.425842 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:51.425842 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:51.425842 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:51.425842 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:51.425842 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:51.427008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4] added
May 13 02:13:51.427008 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:13:51.427008 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:51.427008 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:51.427008 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:13:51.427008 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:13:51.427008 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:51.427370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:51.428143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:13:51.428143 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0353(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:51.428280 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:13:51.428533 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:51.428733 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:13:51.688020 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:51.734679 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:51.817835 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Successfully updated port: f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:51.876527 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-changed-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:51.876527 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Refreshing instance network info cache due to event network-changed-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:51.876632 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] Acquiring lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:51.876774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] Acquired lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:51.876894 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Refreshing network info cache for port f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:51.888810 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1313943128',display_name='tempest-TestVolumeBootPattern-server-1313943128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1313943128',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fP3aRh+LWusUz7oNEFSOGESwV/hqdoRTMa02CMcsmfNZ8dXe1AGp2xZVHPt82vtelxWMNQuHX3X4ExjvsmBFsbonEz1jDix+w3cS5+6FBVGrNyiavIGKiBHXmJllEng==',key_name='tempest-keypair-1067467606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-4sbwtqbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=cf28a209-585f-43b9-9612-cc47883cdadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:51.889284 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:51.890046 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:51.891318 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid cf28a209-585f-43b9-9612-cc47883cdadc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:51.901973 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:52.049165 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating instance_info_cache with network_info: [{"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:52.319609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:52.379890 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:52.394902 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <uuid>cf28a209-585f-43b9-9612-cc47883cdadc</uuid>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <name>instance-00000036</name>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-1313943128</nova:name>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:48</nova:creationTime>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         <nova:port uuid="df923fe3-7d23-4205-9a8c-6b4bc62da7eb">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="serial">cf28a209-585f-43b9-9612-cc47883cdadc</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="uuid">cf28a209-585f-43b9-9612-cc47883cdadc</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/disk.config"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <alias name="ua-ccac6f30-47c4-4bca-9425-b817263826b4"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-4"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <serial>ccac6f30-47c4-4bca-9425-b817263826b4</serial>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:4f:2f:67"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <target dev="tapdf923fe3-7d"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/console.log" append="off"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:52.394902 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Preparing to wait for external event network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1313943128',display_name='tempest-TestVolumeBootPattern-server-1313943128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1313943128',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fP3aRh+LWusUz7oNEFSOGESwV/hqdoRTMa02CMcsmfNZ8dXe1AGp2xZVHPt82vtelxWMNQuHX3X4ExjvsmBFsbonEz1jDix+w3cS5+6FBVGrNyiavIGKiBHXmJllEng==',key_name='tempest-keypair-1067467606',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-4sbwtqbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=cf28a209-585f-43b9-9612-cc47883cdadc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:52.397350 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:52.398011 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:52.398365 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:52.398685 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.398986 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:52.399259 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:52.400051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.400228 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd410838d-3c4d-5b48-988a-0c59dcdb083a', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:52.407078 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.408394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:52.411133 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.411955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf923fe3-7d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:52.411955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf923fe3-7d, col_values=(('qos', UUID('b036afe6-25c3-4f81-8830-5c0848246848')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:52.412183 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf923fe3-7d, col_values=(('external_ids', {'iface-id': 'df923fe3-7d23-4205-9a8c-6b4bc62da7eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:2f:67', 'vm-uuid': 'cf28a209-585f-43b9-9612-cc47883cdadc'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:52.413063 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.414394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:52.420521 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:52.422117 np0000000663 nova-compute[98103]: INFO os_vif [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d')
May 13 02:13:52.429020 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:13:52.429679 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:52.442774 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:52.442774 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:13:52.447286 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:13:52.447286 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.455543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.461963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.465314 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.474010 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.474265 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.479580 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.479894 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:52.515700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.50.100,3260]
May 13 02:13:52.515700 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.50.100,3260] successful.
May 13 02:13:52.515700 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.529617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.531190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.40.100,3260]
May 13 02:13:52.531190 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.40.100,3260] successful.
May 13 02:13:52.531190 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.545612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.550795 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.551150 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:52.551418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:52.551418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:52.551972 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Releasing lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:52.552301 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance network_info: |[{"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:52.554401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Start _get_guest_xml network_info=[{"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:52.555588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('13', '-', '-', 0) found on session 125 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:52.556303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:52.559031 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:52.560621 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1297776828', uuid='57b9a268-da0a-4f73-9b7f-68068852374f'), owner=OwnerMeta(userid='63c9dc09e45e4cdeb438d163532a8849', username='tempest-TestEncryptedCinderVolumes-1329189432-project-member', projectid='cf4cdaf6da19497586ec83765be014b7', projectname='tempest-TestEncryptedCinderVolumes-1329189432'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638432.5601237) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:52.562507 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:52.562868 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:52.564346 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.564925 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:13:52.565177 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:13:52.565487 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:52.565693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:13:52.566177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:52.567515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:52.568198 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:52.568431 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:52.568601 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:52.568766 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:52.568920 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:52.569025 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:52.569248 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:52.569379 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:52.569483 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:52.569595 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:52.569723 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:52.579590 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 125 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:52.579791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:52.584874 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1297776828',display_name='tempest-TestEncryptedCinderVolumes-server-1297776828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1297776828',id=56,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf0wvTDga1iEFE6DtKjjhj0Z11bKXFgbcyGhtalIOXGofGCNOEYuYG/4D2MrErQ34drNBVijXQ26FXl7vEFsi7KAW47dAsqTljW69HCmPBa+8JaACSJtSU8uQq+7YuS5g==',key_name='tempest-keypair-1864197042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-6k8p0qyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=57b9a268-da0a-4f73-9b7f-68068852374f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:52.585159 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:52.585515 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:52.586050 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'pci_devices' on Instance uuid 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:52.587122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('14', '-', '-', 0) found on session 126 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:13:52.587234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:13:52.606900 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 126 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:13:52.607061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:13:52.627470 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:52.699423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:52.700245 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:52.700418 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Creating image(s)
May 13 02:13:52.701366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:52.701366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:52.701746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:52.702232 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:52.705489 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:52.706718 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:52.821545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:52.822051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:52.822574 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:52.823160 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:52.826405 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:52.826898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:52.927821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:52.928454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:53.011531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk 1073741824" returned: 0 in 0.083s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:53.011994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:53.012408 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:53.091637 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <uuid>57b9a268-da0a-4f73-9b7f-68068852374f</uuid>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <name>instance-00000038</name>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1297776828</nova:name>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:52</nova:creationTime>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:user uuid="63c9dc09e45e4cdeb438d163532a8849">tempest-TestEncryptedCinderVolumes-1329189432-project-member</nova:user>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:project uuid="cf4cdaf6da19497586ec83765be014b7">tempest-TestEncryptedCinderVolumes-1329189432</nova:project>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         <nova:port uuid="ea775620-9d16-43bb-9d8e-7d8e589b9a29">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="serial">57b9a268-da0a-4f73-9b7f-68068852374f</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="uuid">57b9a268-da0a-4f73-9b7f-68068852374f</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.config"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:de:1d:bf"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <target dev="tapea775620-9d"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/console.log" append="off"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:53.091637 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:53.098286 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Preparing to wait for external event network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:53.098286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:53.098286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:53.098286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1297776828',display_name='tempest-TestEncryptedCinderVolumes-server-1297776828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1297776828',id=56,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf0wvTDga1iEFE6DtKjjhj0Z11bKXFgbcyGhtalIOXGofGCNOEYuYG/4D2MrErQ34drNBVijXQ26FXl7vEFsi7KAW47dAsqTljW69HCmPBa+8JaACSJtSU8uQq+7YuS5g==',key_name='tempest-keypair-1864197042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-6k8p0qyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=57b9a268-da0a-4f73-9b7f-68068852374f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.102220 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:53.102805 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:53.104114 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.104390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '003a89a2-bc81-5442-9920-91f1174cf62c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:53.105445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.106439 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:53.112732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.120541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.120541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea775620-9d, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:53.121042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea775620-9d, col_values=(('qos', UUID('4bb6f275-92c0-4cf2-ba7c-622690adddc7')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:53.121322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea775620-9d, col_values=(('external_ids', {'iface-id': 'ea775620-9d16-43bb-9d8e-7d8e589b9a29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:1d:bf', 'vm-uuid': '57b9a268-da0a-4f73-9b7f-68068852374f'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:53.124771 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.124771 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:53.135120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a807eeda-cfcf-49f2-9bd8-788536715063 req-ebd60a54-cf22-49fe-95b0-a349ddc75311 service nova] Releasing lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:53.135120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquired lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:53.135120 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:13:53.137045 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:53.139348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:53.140427 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:13:53.141159 np0000000663 nova-compute[98103]: INFO os_vif [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d')
May 13 02:13:53.141932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:53.252525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:53.252961 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Cannot resize image /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:13:53.253295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:13:53.253437 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Ensure instance console log exists: /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:13:53.253731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:53.253926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:53.254066 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:53.392890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:13:53.680045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:53.680297 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:53.733132 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:13:53.899727 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:53.958229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:53.958382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:53.958554 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:4f:2f:67, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:53.959027 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Using config drive
May 13 02:13:54.058626 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating instance_info_cache with network_info: [{"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:13:54.185613 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:13:54.414649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Found WWN 330000000391b8c72 for multipath device dm-7 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:13:54.415018 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:13:54.415239 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== connect_volume: return (3880ms) {'type': 'block', 'scsi_wwn': '330000000391b8c72', 'path': '/dev/dm-7', 'multipath_id': '330000000391b8c72'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:13:54.415388 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000391b8c72', 'path': '/dev/dm-7', 'multipath_id': '330000000391b8c72'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:13:54.468721 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:54.560682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Releasing lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:13:54.561069 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance network_info: |[{"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:13:54.562818 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Start _get_guest_xml network_info=[{"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:13:54.565354 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:13:54.566452 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1695220652', uuid='6f68c3ac-8dfc-4202-9786-2ba013b12833'), owner=OwnerMeta(userid='3b3cc512843b427fa59414fdf92f5e76', username='tempest-AttachVolumeTestJSON-1185409082-project-member', projectid='c97b10a192fd43f689e55b4537a4f824', projectname='tempest-AttachVolumeTestJSON-1185409082'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638434.566147) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:13:54.567542 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:13:54.567892 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:13:54.568865 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:13:54.569024 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:13:54.570027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:13:54.570349 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:13:54.570526 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:13:54.570621 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:13:54.570779 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:13:54.570886 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:13:54.570980 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:13:54.571142 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:13:54.571247 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:13:54.571470 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:13:54.571567 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:13:54.571709 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:13:54.582053 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1695220652',display_name='tempest-AttachVolumeTestJSON-server-1695220652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-1695220652',id=57,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXPJjWGYN0mCVh3usS2AX3xyR959EesySMcY4K9fLeaJvpiIEKxVj22oSKAb6jTCPd5/sByGBIStfIJjCybX9GU1JmznuPyO7NVOwe0EYAWMbHx1onZSaxzpGlB9FPOA==',key_name='tempest-keypair-1757250784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-6bhjh0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=6f68c3ac-8dfc-4202-9786-2ba013b12833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:54.582305 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:54.582907 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:54.583506 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:54.597519 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Creating config drive at /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/disk.config
May 13 02:13:54.601364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp69x7y9bt {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:54.657184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp69x7y9bt" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:54.699705 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:54.699926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:54.699926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:de:1d:bf, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:54.700403 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Using config drive
May 13 02:13:54.739991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:54.740725 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:54.744261 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:13:54.744477 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Claim successful on node np0000000663
May 13 02:13:54.923512 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-627379103',display_name='tempest-TestVolumeBootPatternV346-server-627379103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-627379103',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrt70zcdxnPueTjEIhKkVPXhOZJXjkpbqcmLy2SgoHmlDhMCthIsS+fL9fBtJYqduHfTVthoO/FIdDB3fb0d4vkGB40YVqv72sOBPdHC1MLVSN69LzFhLbAWucBBQxqpw==',key_name='tempest-keypair-1201833150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-fp6ecoue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=fd054b4f-181b-44ac-8e14-86ea3659208c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:13:54.924112 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:54.924336 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:54.925019 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'pci_devices' on Instance uuid fd054b4f-181b-44ac-8e14-86ea3659208c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <uuid>6f68c3ac-8dfc-4202-9786-2ba013b12833</uuid>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <name>instance-00000039</name>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:name>tempest-AttachVolumeTestJSON-server-1695220652</nova:name>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:54</nova:creationTime>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:user uuid="3b3cc512843b427fa59414fdf92f5e76">tempest-AttachVolumeTestJSON-1185409082-project-member</nova:user>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:project uuid="c97b10a192fd43f689e55b4537a4f824">tempest-AttachVolumeTestJSON-1185409082</nova:project>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         <nova:port uuid="f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="serial">6f68c3ac-8dfc-4202-9786-2ba013b12833</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="uuid">6f68c3ac-8dfc-4202-9786-2ba013b12833</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.config"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:c0:4d:60"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <target dev="tapf47d27c6-c2"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/console.log" append="off"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:55.088176 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Preparing to wait for external event network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1695220652',display_name='tempest-AttachVolumeTestJSON-server-1695220652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-1695220652',id=57,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXPJjWGYN0mCVh3usS2AX3xyR959EesySMcY4K9fLeaJvpiIEKxVj22oSKAb6jTCPd5/sByGBIStfIJjCybX9GU1JmznuPyO7NVOwe0EYAWMbHx1onZSaxzpGlB9FPOA==',key_name='tempest-keypair-1757250784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-6bhjh0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=6f68c3ac-8dfc-4202-9786-2ba013b12833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:55.088176 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:55.092171 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:55.092171 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:55.092362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.092841 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.093232 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:55.094065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.094293 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4db3f7e5-548d-5bba-a483-d5953becc75f', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.095510 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.096476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:55.112391 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.125374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.125852 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf47d27c6-c2, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.126052 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf47d27c6-c2, col_values=(('qos', UUID('70078dbe-c2c8-4fd0-8d3e-b0f87c438212')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.126290 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf47d27c6-c2, col_values=(('external_ids', {'iface-id': 'f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:4d:60', 'vm-uuid': '6f68c3ac-8dfc-4202-9786-2ba013b12833'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.127781 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.129412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:55.154843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.167880 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.169438 np0000000663 nova-compute[98103]: INFO os_vif [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2')
May 13 02:13:55.209673 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:55.260890 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.382606 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Creating config drive at /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.config
May 13 02:13:55.387375 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ff28fbb0-d6b9-42b1-a291-3631da4a2053 req-e20db052-7861-4fdc-9b2f-a493425c9eb3 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:55.387697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff28fbb0-d6b9-42b1-a291-3631da4a2053 req-e20db052-7861-4fdc-9b2f-a493425c9eb3 service nova] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:55.388272 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff28fbb0-d6b9-42b1-a291-3631da4a2053 req-e20db052-7861-4fdc-9b2f-a493425c9eb3 service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:55.388272 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ff28fbb0-d6b9-42b1-a291-3631da4a2053 req-e20db052-7861-4fdc-9b2f-a493425c9eb3 service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:55.388384 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ff28fbb0-d6b9-42b1-a291-3631da4a2053 req-e20db052-7861-4fdc-9b2f-a493425c9eb3 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Processing event network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:13:55.392975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qkugllz {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:55.434078 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] End _get_guest_xml xml=<domain type="qemu">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <uuid>fd054b4f-181b-44ac-8e14-86ea3659208c</uuid>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <name>instance-00000037</name>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPatternV346-server-627379103</nova:name>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:13:50</nova:creationTime>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:user uuid="b8648b9097814fd5848d1e51cbecf9a6">tempest-TestVolumeBootPatternV346-1111989009-project-member</nova:user>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:project uuid="0787f738661944129f59b1250bc5e71e">tempest-TestVolumeBootPatternV346-1111989009</nova:project>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         <nova:port uuid="3de05011-8c4a-4392-9c34-dc3b51e22887">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <system>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="serial">fd054b4f-181b-44ac-8e14-86ea3659208c</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="uuid">fd054b4f-181b-44ac-8e14-86ea3659208c</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </system>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <os>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </os>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <features>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </features>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   <devices>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/disk.config"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <alias name="ua-6222d865-5c52-4e13-9ce0-c9adfa067fb4"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-7"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <serial>6222d865-5c52-4e13-9ce0-c9adfa067fb4</serial>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </disk>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:c1:53:86"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <target dev="tap3de05011-8c"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </interface>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/console.log" append="off"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </serial>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <video>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </video>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </rng>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:   </devices>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]: </domain>
May 13 02:13:55.434078 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:13:55.437249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Preparing to wait for external event network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:13:55.437249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:55.437249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:55.437249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:55.438020 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-627379103',display_name='tempest-TestVolumeBootPatternV346-server-627379103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-627379103',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrt70zcdxnPueTjEIhKkVPXhOZJXjkpbqcmLy2SgoHmlDhMCthIsS+fL9fBtJYqduHfTVthoO/FIdDB3fb0d4vkGB40YVqv72sOBPdHC1MLVSN69LzFhLbAWucBBQxqpw==',key_name='tempest-keypair-1201833150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-fp6ecoue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=fd054b4f-181b-44ac-8e14-86ea3659208c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:13:55.438400 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:13:55.439569 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:13:55.440085 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:13:55.442686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.443367 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.443953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:13:55.447018 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.447344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10c20b9c-14a3-53ce-90d8-e0680222d44f', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.448363 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.449429 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:55.462445 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.467322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.468074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de05011-8c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.470257 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de05011-8c, col_values=(('qos', UUID('3e8a6ad9-fe87-4d70-a8b2-2a5b3a02fb28')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.470969 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de05011-8c, col_values=(('external_ids', {'iface-id': '3de05011-8c4a-4392-9c34-dc3b51e22887', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:53:86', 'vm-uuid': 'fd054b4f-181b-44ac-8e14-86ea3659208c'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:13:55.471735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qkugllz" returned: 0 in 0.078s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:55.473715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:13:55.489816 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.490837 np0000000663 nova-compute[98103]: INFO os_vif [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c')
May 13 02:13:55.494883 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.516286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.522124 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.561304 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.575181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.727174 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.937337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.970264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:55.977411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.062186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.152646 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638436.1521945, cf28a209-585f-43b9-9612-cc47883cdadc => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:56.153172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:13:56.153596 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] VM Started (Lifecycle Event)
May 13 02:13:56.156207 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:13:56.162079 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance spawned successfully.
May 13 02:13:56.162966 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:13:56.312346 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.324952 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.331384 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:13:56.331684 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:13:56.339535 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.353186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.363070 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:56.474706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-vif-unplugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:56.474904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:56.475180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:56.475235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:56.475348 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] No event matching network-vif-unplugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 in dict_keys([('network-vif-plugged', 'f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3')]) {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 13 02:13:56.475472 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-13ccfdfa-ad0c-42c7-894c-57d0833060d4 req-c37e361b-b4d5-4f9b-969b-ebc534e0e0e1 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received unexpected event network-vif-unplugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 for instance with vm_state building and task_state spawning.
May 13 02:13:56.658219 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:56.660891 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:56.670495 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.670495 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.670699 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.670788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.671064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.671308 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:56.700537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:56.700767 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:56.700767 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:c0:4d:60, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:56.701268 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Using config drive
May 13 02:13:56.835463 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:13:57.020524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:57.020524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:13:57.020524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No VIF found with MAC fa:16:3e:c1:53:86, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:13:57.020524 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Using config drive
May 13 02:13:57.163317 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:13:57.163619 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638437.1633966, cf28a209-585f-43b9-9612-cc47883cdadc => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:57.163796 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] VM Paused (Lifecycle Event)
May 13 02:13:57.177689 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Took 10.14 seconds to spawn the instance on the hypervisor.
May 13 02:13:57.178014 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:57.209346 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:57.337532 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Creating config drive at /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.config
May 13 02:13:57.345053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ke3q7kn {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:57.375861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.633s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:57.378621 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:13:57.420720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3ke3q7kn" returned: 0 in 0.076s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:57.467905 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:57.467905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:57.468906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:57.468906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:57.468906 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] No waiting events found dispatching network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:57.469200 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received unexpected event network-vif-plugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb for instance with vm_state active and task_state None.
May 13 02:13:57.469200 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:57.469354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:57.469556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:57.469829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:57.470370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Processing event network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:13:57.470484 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:57.470686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:57.470857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:57.471069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:57.471242 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] No waiting events found dispatching network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:57.471390 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-cd4445b4-b391-4cc7-93f3-ff721e1f1c96 req-ee8523a2-61f9-4791-aa15-c6fd3981cfe0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received unexpected event network-vif-plugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 for instance with vm_state building and task_state spawning.
May 13 02:13:57.472346 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:13:57.476432 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:13:57.491761 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance spawned successfully.
May 13 02:13:57.492227 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:13:57.529177 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:57.667110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:57.669891 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638437.6695828, cf28a209-585f-43b9-9612-cc47883cdadc => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:57.670078 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] VM Resumed (Lifecycle Event)
May 13 02:13:57.689861 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Took 17.51 seconds to build instance.
May 13 02:13:57.716112 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Creating config drive at /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/disk.config
May 13 02:13:57.721375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpupkhd0nz {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:13:57.791720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpupkhd0nz" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:13:57.902198 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:13:57.904486 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:13:57.904941 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:57.905440 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:13:57.924783 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:57.959751 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.006212 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.006326 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.006711 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.006998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.007382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.009544 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:13:58.018125 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5290d2441ac241dfb13a0164caffbbe2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf8b3ecad8f412ca2c2c93812300766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:13:58.174169 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:58.193115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.031s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:58.196356 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:58.196356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.382587 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.391681 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.393632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.404669 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:13:58.429569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.429569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.525373 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Took 8.32 seconds to spawn the instance on the hypervisor.
May 13 02:13:58.525501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:58.572586 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:58.572804 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:58.573108 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:58.573255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:58.573971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Processing event network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:13:58.573971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:58.573971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:58.573971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:58.574275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:58.574275 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] No waiting events found dispatching network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:13:58.575323 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b5f26e43-dde0-4f50-a641-6e52f27f386c req-f96c88c6-d9ce-4171-bd5e-f3d22e224a50 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received unexpected event network-vif-plugged-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 for instance with vm_state building and task_state spawning.
May 13 02:13:58.642542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.666417 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.699391 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638438.6969912, 57b9a268-da0a-4f73-9b7f-68068852374f => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:58.699391 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] VM Started (Lifecycle Event)
May 13 02:13:58.716788 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Successfully created port: ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:13:58.805182 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.834633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:13:58.908698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:13:59.057262 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Took 14.37 seconds to build instance.
May 13 02:13:59.200860 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:13:59.210037 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:13:59.559046 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.889s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:59.562609 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Successfully updated port: ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:13:59.681338 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-changed-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:13:59.681338 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Refreshing instance network info cache due to event network-changed-ceee96c6-5ccb-4279-83dc-7205a74794e2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:13:59.681541 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] Acquiring lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:13:59.681541 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] Acquired lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:13:59.681541 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Refreshing network info cache for port ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:13:59.715428 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638439.715052, 57b9a268-da0a-4f73-9b7f-68068852374f => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:13:59.715719 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] VM Paused (Lifecycle Event)
May 13 02:13:59.772208 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:13:59.783006 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:13:59.797908 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance spawned successfully.
May 13 02:13:59.802237 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:13:59.936385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:13:59.937605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:13:59.939252 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Creating image(s)
May 13 02:13:59.941710 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:13:59.942072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:13:59.946247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:13:59.946247 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:59.950032 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:13:59.951810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:00.029675 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.031028 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.031297 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.035141 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.035794 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.035794 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.036209 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.036662 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.036889 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:14:00.037314 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.85 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:14:00.058584 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-changed-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:00.059551 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Refreshing instance network info cache due to event network-changed-ea775620-9d16-43bb-9d8e-7d8e589b9a29. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:00.059551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] Acquiring lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:00.060037 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] Acquired lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:00.060037 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Refreshing network info cache for port ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:00.066209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:00.088333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.136s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:00.089567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:00.090065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:00.090600 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:14:00.097506 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:14:00.098043 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:00.187121 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:00.219621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.121s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:00.221279 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:00.222193 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:00.259451 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638440.2569149, 57b9a268-da0a-4f73-9b7f-68068852374f => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:00.259866 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] VM Resumed (Lifecycle Event)
May 13 02:14:00.320707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk 1073741824" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:00.322421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:00.322906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:00.368245 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:14:00.376231 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.376595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.378401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.378401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.379570 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.380760 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:00.468182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.145s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:00.468778 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:14:00.469026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:00.488877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:00.572382 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:00.588117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:00.589205 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Cannot resize image /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:14:00.589353 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:14:00.589700 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Ensure instance console log exists: /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:14:00.590970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:00.590970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:00.590970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:00.640894 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:00.682421 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:00.683394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Processing event network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] No waiting events found dispatching network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received unexpected event network-vif-plugged-3de05011-8c4a-4392-9c34-dc3b51e22887 for instance with vm_state building and task_state spawning.
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-changed-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Refreshing instance network info cache due to event network-changed-df923fe3-7d23-4205-9a8c-6b4bc62da7eb. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Acquiring lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Acquired lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:00.686129 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Refreshing network info cache for port df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:00.688680 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:14:00.695226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:14:00.697766 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance spawned successfully.
May 13 02:14:00.698213 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:14:00.730537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:00.770928 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:00.774554 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:00.884268 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:00.894269 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Took 8.19 seconds to spawn the instance on the hypervisor.
May 13 02:14:00.894269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:00.995052 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:01.147865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e294f067-68d4-4797-9091-fb0c78d8d8f6 req-1fd1c7ab-3893-4de2-a294-720648d1c068 service nova] Releasing lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:01.149333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquired lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:01.149333 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:14:01.175864 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updated VIF entry in instance network info cache for port ea775620-9d16-43bb-9d8e-7d8e589b9a29. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:14:01.177683 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating instance_info_cache with network_info: [{"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:01.188887 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:01.211995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.212211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.212434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.212687 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.213067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.213530 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:01.279310 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638441.2789302, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:01.279798 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] VM Started (Lifecycle Event)
May 13 02:14:01.391548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:01.391892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:01.392011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:01.392231 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:14:01.437242 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Took 16.13 seconds to build instance.
May 13 02:14:01.679650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-46af8797-7a33-483e-9d25-df07e899f540 req-3de5e247-d847-41e5-91a8-6f462f4989a2 service nova] Releasing lock "refresh_cache-57b9a268-da0a-4f73-9b7f-68068852374f" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:01.727121 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Took 12.28 seconds to spawn the instance on the hypervisor.
May 13 02:14:01.727121 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:01.779369 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:14:01.786018 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:01.793214 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:01.839034 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:01.947074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.674s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:02.121270 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:02.187868 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updated VIF entry in instance network info cache for port df923fe3-7d23-4205-9a8c-6b4bc62da7eb. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:14:02.188035 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating instance_info_cache with network_info: [{"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:02.245849 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Took 20.29 seconds to build instance.
May 13 02:14:02.300961 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638442.3005736, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:02.301503 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] VM Paused (Lifecycle Event)
May 13 02:14:02.358491 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating instance_info_cache with network_info: [{"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:02.369627 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-changed-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:02.369627 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Refreshing instance network info cache due to event network-changed-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:02.370120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] Acquiring lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:02.370290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] Acquired lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:02.371575 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Refreshing network info cache for port f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:02.517932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:02.694387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd9de3f7-aa35-4f13-b598-9c1fc1c88822 req-95bdb1aa-5af4-4e94-ac45-c3b71d132f29 service nova] Releasing lock "refresh_cache-cf28a209-585f-43b9-9612-cc47883cdadc" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:02.712759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:02.713251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:02.751085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e4b5b4a5-27db-4ace-8cd3-e5dbe72e53ef tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.799s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:02.809176 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:02.815726 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638442.8153036, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:02.815888 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] VM Resumed (Lifecycle Event)
May 13 02:14:02.867040 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Releasing lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:02.867040 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance network_info: |[{"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:14:02.876014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:02.878880 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Start _get_guest_xml network_info=[{"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:14:02.881165 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:02.886884 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:14:02.893779 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:14:02.900252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:02.949555 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:14:02.953114 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336', uuid='5aedc303-4005-4670-a46c-81accc9a0101'), owner=OwnerMeta(userid='5290d2441ac241dfb13a0164caffbbe2', username='tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member', projectid='9cf8b3ecad8f412ca2c2c93812300766', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-679853933'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638442.9516609) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:14:02.963897 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:14:02.964378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:14:02.977067 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:14:02.980214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:14:02.985866 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:14:02.987136 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:14:02.989170 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:14:02.989645 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:14:02.989645 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:14:02.992396 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:14:02.992396 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:14:02.995901 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:14:02.996135 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:14:02.996377 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:14:02.996377 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:14:02.996941 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:14:03.005411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.006817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.066679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachscenariooldversion-server-1422873',id=58,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ufy1F9ekjoIlDEJZZ5kBgeoaIfNkqktBEDvVNW5bH/ADpLyYL4z+LxiSjChBJJKOBJn5YQ3o1sQVfvaxALynlZri4PSy0iUJr9OPXAyr25lBzYFmN06ujgQSTzt1Myg==',key_name='tempest-keypair-1213102951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cf8b3ecad8f412ca2c2c93812300766',ramdisk_id='',reservation_id='r-qfk150cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5290d2441ac241dfb13a0164caffbbe2',uuid=5aedc303-4005-4670-a46c-81accc9a0101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:14:03.067284 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converting VIF {"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:03.068072 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:03.068985 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:03.136116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.142242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.321302 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:03.330047 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:03.368762 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.370216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.445314 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:03.571545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] End _get_guest_xml xml=<domain type="qemu">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <uuid>5aedc303-4005-4670-a46c-81accc9a0101</uuid>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <name>instance-0000003a</name>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336</nova:name>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:14:02</nova:creationTime>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:user uuid="5290d2441ac241dfb13a0164caffbbe2">tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member</nova:user>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:project uuid="9cf8b3ecad8f412ca2c2c93812300766">tempest-TestServerVolumeAttachScenarioOldVersion-679853933</nova:project>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         <nova:port uuid="ceee96c6-5ccb-4279-83dc-7205a74794e2">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <system>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="serial">5aedc303-4005-4670-a46c-81accc9a0101</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="uuid">5aedc303-4005-4670-a46c-81accc9a0101</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </system>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <os>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </os>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <features>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </features>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   <devices>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </disk>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.config"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </disk>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:04:5d:30"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <target dev="tapceee96c6-5c"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </interface>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/console.log" append="off"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </serial>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <video>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </video>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </rng>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:   </devices>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: </domain>
May 13 02:14:03.592309 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Preparing to wait for external event network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:03.592309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:03.595957 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachscenariooldversion-server-1422873',id=58,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ufy1F9ekjoIlDEJZZ5kBgeoaIfNkqktBEDvVNW5bH/ADpLyYL4z+LxiSjChBJJKOBJn5YQ3o1sQVfvaxALynlZri4PSy0iUJr9OPXAyr25lBzYFmN06ujgQSTzt1Myg==',key_name='tempest-keypair-1213102951',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cf8b3ecad8f412ca2c2c93812300766',ramdisk_id='',reservation_id='r-qfk150cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5290d2441ac241dfb13a0164caffbbe2',uuid=5aedc303-4005-4670-a46c-81accc9a0101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converting VIF {"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:03.600902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:14:03.603667 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:03.605881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.628524 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f36d96a-2066-573d-915d-265fdd740e79', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:03.637757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:03.646724 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:03.647289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapceee96c6-5c, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:03.650193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapceee96c6-5c, col_values=(('qos', UUID('d71dcb36-6e92-456d-b1b3-a0cb2bd1fd91')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:03.650193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapceee96c6-5c, col_values=(('external_ids', {'iface-id': 'ceee96c6-5ccb-4279-83dc-7205a74794e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:5d:30', 'vm-uuid': '5aedc303-4005-4670-a46c-81accc9a0101'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:03.653234 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:03.657739 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:03.661780 np0000000663 nova-compute[98103]: INFO os_vif [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c')
May 13 02:14:03.738338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.739498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.762745 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updated VIF entry in instance network info cache for port f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:14:03.766116 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating instance_info_cache with network_info: [{"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:03.834366 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638443.8337357, fd054b4f-181b-44ac-8e14-86ea3659208c => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:03.834525 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] VM Started (Lifecycle Event)
May 13 02:14:03.868980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.879276 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:14:03.884384 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:14:03.886258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:03.943747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:03.944213 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12251MB free_disk=72.92529296875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:14:03.944383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:03.944891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:04.008866 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-changed-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:04.016933 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Refreshing instance network info cache due to event network-changed-3de05011-8c4a-4392-9c34-dc3b51e22887. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:04.017701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] Acquiring lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:04.019035 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] Acquired lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:04.019480 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Refreshing network info cache for port 3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:04.270519 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-66bac727-e0f8-46ae-a051-a3e3a0a6fef9 req-85f741ee-edf6-4fd7-9b48-4143416f4ae0 service nova] Releasing lock "refresh_cache-6f68c3ac-8dfc-4202-9786-2ba013b12833" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:04.338154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:04.342213 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:04.524335 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:04.848378 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638444.8454819, fd054b4f-181b-44ac-8e14-86ea3659208c => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:04.848378 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] VM Paused (Lifecycle Event)
May 13 02:14:04.981473 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:05.062644 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance acca535f-2ccf-44dc-b45b-1587bcc4561a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 96973110-5b6f-4469-8513-47e1f791fa60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance cf28a209-585f-43b9-9612-cc47883cdadc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance fd054b4f-181b-44ac-8e14-86ea3659208c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 57b9a268-da0a-4f73-9b7f-68068852374f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5aedc303-4005-4670-a46c-81accc9a0101 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:14:05.065981 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:14:03 up 37 min,  2 users,  load average: 8.62, 7.96, 5.10\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_8b11777492cc476fb87a83ff007dc8b9': '1', 'io_workload': '1', 'num_proj_0787f738661944129f59b1250bc5e71e': '2', 'num_proj_870689e5ef3f426395f7245076bf7085': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1', 'num_proj_cf4cdaf6da19497586ec83765be014b7': '1', 'num_proj_c97b10a192fd43f689e55b4537a4f824': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_9cf8b3ecad8f412ca2c2c93812300766': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:14:05.177292 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updated VIF entry in instance network info cache for port 3de05011-8c4a-4392-9c34-dc3b51e22887. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:14:05.177692 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updating instance_info_cache with network_info: [{"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:05.211287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:05.212356 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:05.212859 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No VIF found with MAC fa:16:3e:04:5d:30, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:05.214190 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Using config drive
May 13 02:14:05.355397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:05.363925 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638445.3635232, fd054b4f-181b-44ac-8e14-86ea3659208c => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:05.364272 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] VM Resumed (Lifecycle Event)
May 13 02:14:05.683341 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58972529-d49b-489d-9adc-12c00aadf263 req-716cc34b-d1bd-45ac-a156-1a3437054dbb service nova] Releasing lock "refresh_cache-fd054b4f-181b-44ac-8e14-86ea3659208c" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:05.730044 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:05.739958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:14:05.740241 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:14:05.744759 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:05.870347 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:05.872642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:05.948557 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Creating config drive at /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.config
May 13 02:14:05.953116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6nu0h40f {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:06.016870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6nu0h40f" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:14:06.248953 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:14:06.520544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:06.558286 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:06.681789 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:06.763238 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-125fbc19-3b09-40ad-8e9b-c99380262bea req-063dc3e3-f97c-4cab-a9ed-4ccfbb8e2790 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:06.763238 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-125fbc19-3b09-40ad-8e9b-c99380262bea req-063dc3e3-f97c-4cab-a9ed-4ccfbb8e2790 service nova] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:06.763519 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-125fbc19-3b09-40ad-8e9b-c99380262bea req-063dc3e3-f97c-4cab-a9ed-4ccfbb8e2790 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:06.764157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-125fbc19-3b09-40ad-8e9b-c99380262bea req-063dc3e3-f97c-4cab-a9ed-4ccfbb8e2790 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:06.765580 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-125fbc19-3b09-40ad-8e9b-c99380262bea req-063dc3e3-f97c-4cab-a9ed-4ccfbb8e2790 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Processing event network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:14:06.768342 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:14:06.770356 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.825s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:06.771139 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.11 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:14:06.962596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:06.997020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:07.749908 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638447.7494988, 5aedc303-4005-4670-a46c-81accc9a0101 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:07.750353 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] VM Started (Lifecycle Event)
May 13 02:14:07.751183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:14:07.755497 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:14:07.759290 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance spawned successfully.
May 13 02:14:07.760733 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:14:08.028481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:08.028688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:08.254424 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:08.257455 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:08.266301 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.266449 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.266824 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.267084 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.267444 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.267720 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:14:08.533523 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:08.650796 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:08.761213 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:14:08.761668 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638448.761274, 5aedc303-4005-4670-a46c-81accc9a0101 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:08.761668 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] VM Paused (Lifecycle Event)
May 13 02:14:08.773805 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Took 8.84 seconds to spawn the instance on the hypervisor.
May 13 02:14:08.773956 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:08.855937 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:08.856147 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:08.859349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:08.859349 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:08.859349 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] No waiting events found dispatching network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:08.859349 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-5ca258cd-744f-4c8e-b579-825c7836db8b req-3fbcff50-b4c7-4fdc-90f7-c5a86d8243f6 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received unexpected event network-vif-plugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 for instance with vm_state active and task_state None.
May 13 02:14:09.264203 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:09.266324 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638449.2660842, 5aedc303-4005-4670-a46c-81accc9a0101 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:09.266486 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] VM Resumed (Lifecycle Event)
May 13 02:14:09.284181 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Took 14.59 seconds to build instance.
May 13 02:14:09.541638 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:09.770029 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:09.772916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:14:09.788214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.107s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:10.164830 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:14:10.508781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-changed-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:10.511760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Refreshing instance network info cache due to event network-changed-ceee96c6-5ccb-4279-83dc-7205a74794e2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:10.512461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] Acquiring lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:10.512526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] Acquired lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:10.512778 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Refreshing network info cache for port ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:10.639523 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:10.639808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:10.640072 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attaching volume 56f3c112-9ba4-46ad-a0ce-02e66f93bade to /dev/vdb
May 13 02:14:10.697119 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:10.709294 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:10.733443 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:10.754717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:10.812247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:10.812805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:10.826196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:10.827909 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fef8:7aec', 'fe80::a881:17ff:fe27:9e78', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fe4f:2f67', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fede:1dbf', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:10.828062 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:10.828842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:10.828842 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:10.829032 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating existing volume attachment record: 8e922f88-1573-4267-af42-9cc1df6f1ae1 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:11.015334 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:11.408771 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:11.409166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:11.409345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:11.412063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:11.412661 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:11.425192 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:11.431249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:11.432594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:11.432977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:11.434061 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:11.434833 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:11.435208 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:11.452471 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:11.452471 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:11.461356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:11.461356 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade] added
May 13 02:14:11.470700 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:11.470700 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:11.470700 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:11.477231 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade] added
May 13 02:14:11.477231 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:11.477231 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:11.477231 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:11.477231 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:11.477231 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:11.477231 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:11.477508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:11.477746 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0425(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:11.477949 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:11.586635 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updated VIF entry in instance network info cache for port ceee96c6-5ccb-4279-83dc-7205a74794e2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:14:11.587036 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating instance_info_cache with network_info: [{"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:11.904767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:11.905304 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:12.089503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9309dda5-a1e1-4a8b-8623-ce5596728931 req-5fef6408-eb73-4490-9837-65d64eecaeca service nova] Releasing lock "refresh_cache-5aedc303-4005-4670-a46c-81accc9a0101" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:12.410193 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Detaching volume ded2c38e-9a70-4c55-8b1d-a70f054f962a
May 13 02:14:12.469570 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Attempting to driver detach volume ded2c38e-9a70-4c55-8b1d-a70f054f962a from mountpoint /dev/vdb
May 13 02:14:12.470350 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:12.478474 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:12.486366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found disk vdb by alias ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:12.489700 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Found disk vdb by alias ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:12.489818 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Attempting to detach device vdb from instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:14:12.490184 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <alias name="ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a"/>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <serial>ded2c38e-9a70-4c55-8b1d-a70f054f962a</serial>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:12.490184 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:12.494112 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:12.494112 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:12.500452 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:12.500452 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.513483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.515962 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully detached device vdb from instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 from the persistent domain config.
May 13 02:14:12.516190 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] (1/8): Attempting to detach device vdb with device alias ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a from instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:14:12.516528 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <alias name="ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a"/>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <serial>ded2c38e-9a70-4c55-8b1d-a70f054f962a</serial>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:12.516528 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:12.521719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.539974 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.540463 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.542865 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:12.601585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.40.100,3260]
May 13 02:14:12.601585 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.40.100,3260] successful.
May 13 02:14:12.601585 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.614431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.50.100,3260]
May 13 02:14:12.614431 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.50.100,3260] successful.
May 13 02:14:12.614431 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.614889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.632420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.642823 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:12.642823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:12.644003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('16', '-', '-', 0) found on session 129 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:12.644152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.657988 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:12.658366 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:12.658716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:12.658716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:12.660319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('17', '-', '-', 0) found on session 130 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:12.660499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:12.676979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 129 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:12.676979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:12.692222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 130 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:12.692222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:13.240586 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638453.240153, 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 => ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:14:13.241513 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ded2c38e-9a70-4c55-8b1d-a70f054f962a for instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:14:13.245356 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully detached device vdb from instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 from the live domain config.
May 13 02:14:13.246862 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:13.247047 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:13.247201 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:13.435546 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:14:13.653355 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:14.458461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found WWN 33000000074f0394c for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:14.459124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:14.459124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '33000000074f0394c', 'path': '/dev/dm-10', 'multipath_id': '33000000074f0394c'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:14.459221 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000074f0394c', 'path': '/dev/dm-10', 'multipath_id': '33000000074f0394c'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:14.460373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.213s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:14.460722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:14.460836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:14.464155 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:14.501180 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [119] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0 (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:14.501619 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:14.501619 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '119'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-903c1099-96ff-4d47-a363-3a2ae8fb06e0', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '130')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:14.501977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '119')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:14.502985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', '120')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:14.504304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6619e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:14.505476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Removing multipathed devices sdd, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:14:14.505476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Flush multipath device 3300000006bdf66ae {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:14:14.539609 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:14.595794 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:14.639888 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:14:14.640259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:14:14.641357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:14:14.654996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:14:14.655288 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:14.674479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.717962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.40.100,3260]
May 13 02:14:14.717962 np0000000663 nova-compute[98103]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.40.100,3260] successful.
May 13 02:14:14.717962 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.739824 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.755224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.797789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.50.100,3260]
May 13 02:14:14.797789 np0000000663 nova-compute[98103]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, portal: 192.168.50.100,3260] successful.
May 13 02:14:14.797789 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.818287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:14.818287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:14.818287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== disconnect_volume: return (1570ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:14.818287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:14.971575 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to attach volume 56f3c112-9ba4-46ad-a0ce-02e66f93bade with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:14:14.972284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:   <alias name="ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade"/>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:   <serial>56f3c112-9ba4-46ad-a0ce-02e66f93bade</serial>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:14.972284 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:14:15.382454 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'flavor' on Instance uuid 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:15.759315 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:16.232418 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:16.388938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-cb8b32b8-2081-495a-9035-ef4af701a922 tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.484s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:16.390441 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.157s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:16.390767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:16.390915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:16.391062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:16.393840 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Terminating instance
May 13 02:14:16.658233 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:16.658423 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:16.658547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:16.658671 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No VIF found with MAC fa:16:3e:58:af:b7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:16.897704 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:14:16.925160 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:16.929337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:16.953201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:16.967889 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:16.997728 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.002051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.174251 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:17.174251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:17.174251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:17.174621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:17.174621 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] No waiting events found dispatching network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:17.174750 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eabf1a1c-4a40-404a-8273-3466da109c75 req-61dacd04-6c3d-44e0-b05b-6acaf52891b6 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:14:17.222685 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.236623 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.271595 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999615796000398 future=<Future at 0x705c4868b950 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:17.272614 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998468152999976 future=<Future at 0x705c4868b950 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:17.273426 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99765520200026 future=<Future at 0x705c4868b950 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:17.280497 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Instance destroyed successfully.
May 13 02:14:17.284017 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lazy-loading 'resources' on Instance uuid 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:17.790918 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:12:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-89639005',display_name='tempest-VolumesBackupsTest-instance-89639005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumesbackupstest-instance-89639005',id=48,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCVVNgh/RBkDnU/DSNAwfoYuzsHj7ZBxgNRIIk4KNaNdufhjcJ5dp5Vy+qtP+wvYm+ge3gZCVbPpsOQFjh4ygoy3kyklLltw+zIIHigjBOWtWXRtp8O3cqfVKii0kXBqg==',key_name='tempest-keypair-376662726',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:29Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b11777492cc476fb87a83ff007dc8b9',ramdisk_id='',reservation_id='r-v3jvlqb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-925143098',owner_user_name='tempest-VolumesBackupsTest-925143098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfb6eb488f574f7c8f932d1d10c62d47',uuid=45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:14:17.791339 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converting VIF {"id": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "address": "fa:16:3e:f8:7a:ec", "network": {"id": "2a0f1c29-68b0-4bb8-9236-11db95684e79", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-130575379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8b11777492cc476fb87a83ff007dc8b9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa727df65-71", "ovs_interfaceid": "a727df65-71b2-488b-8320-e9bb1ec13bb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:17.792609 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:17.793277 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:14:17.796031 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.796031 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa727df65-71, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:17.796812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.798542 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:17.801141 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.801425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2080586d-d645-4b44-8b93-cf01ff69050c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:17.803675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.803675 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:17.805141 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:17.808420 np0000000663 nova-compute[98103]: INFO os_vif [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:7a:ec,bridge_name='br-int',has_traffic_filtering=True,id=a727df65-71b2-488b-8320-e9bb1ec13bb6,network=Network(2a0f1c29-68b0-4bb8-9236-11db95684e79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa727df65-71')
May 13 02:14:17.810071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:17.810791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:17.813332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:17.813332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:17.813332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ded2c38e-9a70-4c55-8b1d-a70f054f962a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:17.813332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:17.850117 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '130')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a, 0): [] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ded2c38e-9a70-4c55-8b1d-a70f054f962a') {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:887}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c243b00>, {}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Disconnecting from: [] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] <== disconnect_volume: return (37ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:17.850117 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Deleting instance files /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7_del
May 13 02:14:17.851646 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Deletion of /opt/stack/data/nova/instances/45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7_del complete
May 13 02:14:18.238385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a7dc6476-1692-4adf-8c10-fe33149e35d4 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.598s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:18.359488 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Took 1.46 seconds to destroy the instance on the hypervisor.
May 13 02:14:18.359982 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:14:18.360513 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:14:18.360629 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:14:18.360839 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:18.487941 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:19.248088 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:19.251252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] Acquiring lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:19.252058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:19.252495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:19.252778 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] No waiting events found dispatching network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:19.253062 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-unplugged-a727df65-71b2-488b-8320-e9bb1ec13bb6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:14:19.253351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Received event network-vif-deleted-a727df65-71b2-488b-8320-e9bb1ec13bb6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:19.253606 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Neutron deleted interface a727df65-71b2-488b-8320-e9bb1ec13bb6; detaching it from the instance and deleting it from the info cache
May 13 02:14:19.253828 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:19.546030 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:19.758622 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c44383f9-e869-4974-8e70-e87e3b479526 req-fc7eafb7-3dd0-488e-92be-df3cd5c7f570 service nova] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Detach interface failed, port_id=a727df65-71b2-488b-8320-e9bb1ec13bb6, reason: Instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:14:20.049891 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Took 1.69 seconds to deallocate network for instance.
May 13 02:14:20.079673 np0000000663 nova-compute[98103]: WARNING nova.volume.cinder [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Attachment 859c0cc5-9c83-4f7e-9616-745aedd683ff does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 859c0cc5-9c83-4f7e-9616-745aedd683ff. (HTTP 404) (Request-ID: req-fc2d4808-e431-45c2-8788-008663ef2938)
May 13 02:14:20.080067 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Took 0.02 seconds to detach 1 volumes for instance.
May 13 02:14:20.586530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:20.587048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:20.756959 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:21.103778 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:14:21.104044 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:14:21.607061 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:14:22.113485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.527s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:22.179025 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Deleted allocations for instance 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7
May 13 02:14:22.815359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:23.188134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-65e2a034-c940-4e39-8f8c-f2e9b389f01e tempest-VolumesBackupsTest-925143098 tempest-VolumesBackupsTest-925143098-project-member] Lock "45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.799s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:25.759185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:26.923216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:27.397530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:27.816291 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:28.877121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:28.877121 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:29.378209 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Detaching volume 56f3c112-9ba4-46ad-a0ce-02e66f93bade
May 13 02:14:29.438835 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to driver detach volume 56f3c112-9ba4-46ad-a0ce-02e66f93bade from mountpoint /dev/vdb
May 13 02:14:29.448075 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:29.451651 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:29.451762 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Attempting to detach device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:14:29.452010 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <alias name="ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade"/>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <serial>56f3c112-9ba4-46ad-a0ce-02e66f93bade</serial>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:29.452010 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:29.461028 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config.
May 13 02:14:29.461232 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] (1/8): Attempting to detach device vdb with device alias ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:14:29.461559 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <alias name="ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade"/>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <serial>56f3c112-9ba4-46ad-a0ce-02e66f93bade</serial>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:29.461559 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:30.028922 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638470.0271378, 96973110-5b6f-4469-8513-47e1f791fa60 => ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:14:30.030567 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-56f3c112-9ba4-46ad-a0ce-02e66f93bade for instance 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:14:30.033846 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config.
May 13 02:14:30.035272 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:30.035662 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:30.035851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:30.036319 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:30.036745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '56f3c112-9ba4-46ad-a0ce-02e66f93bade', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:30.036925 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-786979af-eb73-4caf-9e64-8ec6bfe964fa (non-flash)
May 13 02:14:30.069214 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [130] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-786979af-eb73-4caf-9e64-8ec6bfe964fa (non-flash)
May 13 02:14:30.069685 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:30.069685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '129'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '130'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-786979af-eb73-4caf-9e64-8ec6bfe964fa', '131')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:30.070044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '129')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:30.071309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade', '130')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:30.072464 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487163e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'): ({'sdl'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:30.072657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Removing multipathed devices sdk, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:14:30.072962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flush multipath device 33000000074f0394c {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:14:30.109565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:30.145591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:30.181634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:14:30.181853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:14:30.183003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:14:30.195993 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:14:30.196232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:30.211648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.246547 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.40.100,3260]
May 13 02:14:30.246547 np0000000663 nova-compute[98103]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.40.100,3260] successful.
May 13 02:14:30.246547 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.264549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.279268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.317810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 130, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.50.100,3260]
May 13 02:14:30.317810 np0000000663 nova-compute[98103]: Logout of [sid: 130, target: iqn.2023-03.storpool.com:os--volume-56f3c112-9ba4-46ad-a0ce-02e66f93bade, portal: 192.168.50.100,3260] successful.
May 13 02:14:30.317810 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.337688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:30.337872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:30.337974 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== disconnect_volume: return (302ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:30.338123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:30.760581 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:30.891923 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:31.898295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0615737a-354e-4b6c-ba42-987c11ac5e2c tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.024s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:32.271495 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00044182900001032976 future=<Future at 0x705c4868b950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:32.271995 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Emitting event <LifecycleEvent: 1778638457.270922, 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:32.272193 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:32.272339 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] VM Stopped (Lifecycle Event)
May 13 02:14:32.774956 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: 45c76e3a-8a7e-4d5c-8de6-f29522e9c7e7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:32.825820 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:33.452353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:33.453636 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:33.958276 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:34.966686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:35.765363 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:36.226495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:36.226981 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:36.226981 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attaching volume 8dbadb68-00fe-4ed7-917b-88010c33ca6f to /dev/vdb
May 13 02:14:36.289961 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:36.303799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:36.328980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:36.382849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:36.383140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:36.384770 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:36.385899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:36.395050 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:36.398036 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fe4f:2f67', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fede:1dbf', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:36.398184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:36.398311 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:36.399255 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:36.399255 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating existing volume attachment record: 39cdbee8-148c-4ba1-a010-8db52866067a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:36.889679 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:36.970996 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:36.971589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:36.972349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:36.972712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:36.973006 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:36.987342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:36.988957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:36.990943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:36.991502 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:36.992199 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:36.992540 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:37.010220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:37.010220 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:37.018290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:37.018290 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:37.027530 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f] added
May 13 02:14:37.027530 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:37.027530 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:37.027530 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:37.027530 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:37.027530 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:37.027530 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:37.027896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:37.027949 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:37.028164 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:37.033264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f] added
May 13 02:14:37.033264 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:37.033264 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:37.033264 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:37.033264 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:37.033264 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:37.033264 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:37.033437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:37.033696 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0411(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:37.033869 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:37.827403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:37.895318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:38.028702 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:38.034414 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:38.045772 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:38.045772 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:38.055661 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:38.055661 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.059878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.077864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.090057 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.108570 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.108905 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:38.142819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.40.100,3260]
May 13 02:14:38.142819 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.40.100,3260] successful.
May 13 02:14:38.142819 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.157774 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.166678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.50.100,3260]
May 13 02:14:38.166678 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.50.100,3260] successful.
May 13 02:14:38.166678 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.179825 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.180251 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:38.180622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:38.180622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:38.182046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:38.182645 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('8', '-', '-', 0) found on session 133 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:38.182811 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:38.222646 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 133 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:38.222862 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:38.228573 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.234s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('15', '-', '-', 0) found on session 134 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:38.228573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:38.251932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 134 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:38.252120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:38.991021 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:14:39.051085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:39.051586 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:39.051883 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Attaching volume af750f35-60f0-4440-a125-11ae45f4853a to /dev/vdb
May 13 02:14:39.096356 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:39.108451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:39.135679 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:39.189636 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:39.190053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:39.198884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:39.200932 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fe4f:2f67', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fede:1dbf', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:39.201229 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:39.201804 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:39.201804 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:39.202307 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating existing volume attachment record: c1d3831d-c293-433c-ace1-10932fb93e9f {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:39.808860 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '57b9a268-da0a-4f73-9b7f-68068852374f', 'attached_at': '', 'detached_at': '', 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'serial': 'af750f35-60f0-4440-a125-11ae45f4853a'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:14:39.814553 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:39.815016 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:39.815228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:39.890816 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:39.890989 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:40.010612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found WWN 330000000a04c93cb for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:40.011292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:40.012256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000a04c93cb', 'path': '/dev/dm-0', 'multipath_id': '330000000a04c93cb'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:40.012256 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a04c93cb', 'path': '/dev/dm-0', 'multipath_id': '330000000a04c93cb'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:40.012421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:40.013312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:40.015680 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:40.029966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:40.031528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:40.036922 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:40.037606 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:40.038329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:40.039249 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:40.053257 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:40.053257 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:40.061991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:40.061991 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:40.074572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a] added
May 13 02:14:40.074572 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:40.074572 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:40.074572 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:40.074572 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:40.074572 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:40.074572 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:40.075253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:40.075253 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:40.075451 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a] added
May 13 02:14:40.083413 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:40.083413 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:40.083413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:40.083754 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0445(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:40.083754 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:40.395481 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:40.522797 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to attach volume 8dbadb68-00fe-4ed7-917b-88010c33ca6f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:14:40.524386 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:   <alias name="ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f"/>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:   <serial>8dbadb68-00fe-4ed7-917b-88010c33ca6f</serial>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:40.524386 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:14:40.550162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:40.550322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:40.550410 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:40.554189 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98103) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 02:14:40.554189 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'flavor' on Instance uuid cf28a209-585f-43b9-9612-cc47883cdadc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:40.776744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.075844 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:41.084029 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:41.090819 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:41.090819 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:41.098357 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:41.098357 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.103704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.110768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.120014 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.120349 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.127811 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.128221 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:41.165063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.40.100,3260]
May 13 02:14:41.165063 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.40.100,3260] successful.
May 13 02:14:41.165063 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.177511 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.179267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.50.100,3260]
May 13 02:14:41.179267 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.50.100,3260] successful.
May 13 02:14:41.179267 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.200240 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.200940 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:41.201388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:41.201579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:41.203569 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('16', '-', '-', 0) found on session 135 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:41.203689 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:41.205666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:41.233677 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 135 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:41.233769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.235347 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:41.235675 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:41.236412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:41.236541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:41.237913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('17', '-', '-', 0) found on session 136 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:41.238044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:41.263028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 136 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:41.264321 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:41.402722 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:41.580925 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.583437 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.610268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.638307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.642481 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:41.888162 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998398184000052 future=<Future at 0x705c6c77f440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:41.888329 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997634695000215 future=<Future at 0x705c6c77f440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:41.892630 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance destroyed successfully.
May 13 02:14:41.893377 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.992610889000389 future=<Future at 0x705c6c77f440 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:41.893712 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'numa_topology' on Instance uuid cf28a209-585f-43b9-9612-cc47883cdadc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:42.036060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:14:42.195552 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:42.198113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:42.198113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:42.198113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No VIF found with MAC fa:16:3e:58:af:b7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:42.255060 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:42.255435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:42.255665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:42.256654 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:42.256654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] No waiting events found dispatching network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:42.256654 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8f827e3f-f912-4ab7-bb96-9c7cf4c55b93 req-a8132ef9-fc91-4bd6-956c-8f346de80bbf service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received unexpected event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb for instance with vm_state active and task_state powering-off.
May 13 02:14:42.397333 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<cf28a209-585f-43b9-9612-cc47883cdadc> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:14:42.397644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:42.536933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:42.538261 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:42.538261 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attaching volume c978476a-a85c-44cd-ada6-eb5a6b8abdb8 to /dev/vdb
May 13 02:14:42.589430 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:42.601258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:42.622844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:42.666966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:42.667249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:42.675502 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:42.676856 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fede:1dbf', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:42.677018 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:42.677190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:42.677480 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:42.677768 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating existing volume attachment record: ac4cd0bf-e892-4313-a8c2-4a772c4f93b1 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:42.828892 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:42.907135 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c2f6c17e-d6ab-4f25-a9ec-dbd4a1ef4c9f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.357s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:43.056282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found WWN 330000000baa20d19 for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:43.056935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:43.059186 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== connect_volume: return (3243ms) {'type': 'block', 'scsi_wwn': '330000000baa20d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000baa20d19'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:43.059415 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000baa20d19', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000baa20d19'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:43.064628 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:14:43.064815 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:14:43.065645 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:14:43.067489 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x705c6c6434a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '57b9a268-da0a-4f73-9b7f-68068852374f', 'attached_at': '', 'detached_at': '', 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'serial': 'af750f35-60f0-4440-a125-11ae45f4853a'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:14:43.067810 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.cryptsetup [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 13 02:14:43.067996 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98103) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 02:14:43.068136 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.cryptsetup [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] opening encrypted volume /dev/dm-10 {{(pid=98103) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 13 02:14:43.196411 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:43.228030 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:43.228519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:43.228791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:43.700028 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Attempting to attach volume af750f35-60f0-4440-a125-11ae45f4853a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:14:43.703641 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:   <alias name="ua-af750f35-60f0-4440-a125-11ae45f4853a"/>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:   <serial>af750f35-60f0-4440-a125-11ae45f4853a</serial>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:43.703641 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:14:43.767295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bbdfb925-9a86-4edd-aec0-8e863309e91f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.540s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:44.348593 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:44.349052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:44.349052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:44.349052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:44.349434 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] No waiting events found dispatching network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:44.349434 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-2f1db432-949e-497b-8dd3-6aea7c1d6cf2 req-e4f1e2ca-8b53-459c-b262-4403946940fc service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received unexpected event network-vif-unplugged-df923fe3-7d23-4205-9a8c-6b4bc62da7eb for instance with vm_state stopped and task_state None.
May 13 02:14:45.284421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.056s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:45.284709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:45.299228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:45.299789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:45.300352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:45.300635 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:45.300966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:45.301118 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:45.315275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:45.315275 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:45.325187 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:45.325187 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:45.330317 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8] added
May 13 02:14:45.330317 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:45.330317 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:45.330317 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:45.330317 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:45.330317 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:45.330317 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:45.331441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:45.331441 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:45.331441 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:45.338725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8] added
May 13 02:14:45.338725 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:45.338725 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:45.338725 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:45.338725 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:45.338725 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:45.338725 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:45.339063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:45.339063 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0384(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:45.339178 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:45.384867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:45.385273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:45.385273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:45.385273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:de:1d:bf, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:45.792900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:46.332934 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:46.339833 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:46.350875 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:46.350875 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:46.359241 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:46.359241 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.371690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.375610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.401539 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.402536 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.410657 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:46.488538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.40.100,3260]
May 13 02:14:46.488538 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.40.100,3260] successful.
May 13 02:14:46.488538 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.504608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:46.526274 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:46.526711 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:46.526711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.227s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:46.527168 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:46.528852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('20', '-', '-', 0) found on session 139 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:46.528991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:46.559027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 139 and hctl ['20', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:46.559428 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:46.874415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:46.874415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:46.874415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:46.874415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:46.874415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:46.875390 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Terminating instance
May 13 02:14:46.989065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c649c37b-90e8-4e5d-ba32-4b564d264a4b tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.937s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:47.379751 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:14:47.388699 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Instance destroyed successfully.
May 13 02:14:47.389343 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid cf28a209-585f-43b9-9612-cc47883cdadc {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:47.447294 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:47.447738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:47.481145 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.50.100,3260]
May 13 02:14:47.481145 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.50.100,3260] successful.
May 13 02:14:47.481145 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:47.492985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:47.518123 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.215s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('19', '-', '-', 0) found on session 138 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:47.518123 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:47.532518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 138 and hctl ['19', '*', '*', 0] yield: sdo {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:47.532518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:47.687130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:47.687280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:47.830718 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.893935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1313943128',display_name='tempest-TestVolumeBootPattern-server-1313943128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1313943128',id=54,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8fP3aRh+LWusUz7oNEFSOGESwV/hqdoRTMa02CMcsmfNZ8dXe1AGp2xZVHPt82vtelxWMNQuHX3X4ExjvsmBFsbonEz1jDix+w3cS5+6FBVGrNyiavIGKiBHXmJllEng==',key_name='tempest-keypair-1067467606',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:13:57Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-4sbwtqbl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=cf28a209-585f-43b9-9612-cc47883cdadc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:14:47.894199 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "address": "fa:16:3e:4f:2f:67", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf923fe3-7d", "ovs_interfaceid": "df923fe3-7d23-4205-9a8c-6b4bc62da7eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:47.894890 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:47.895340 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:14:47.897013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.897417 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf923fe3-7d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:47.898637 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.899546 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:47.901859 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.903269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.903269 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b036afe6-25c3-4f81-8830-5c0848246848) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:47.903613 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:47.904357 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:47.909697 np0000000663 nova-compute[98103]: INFO os_vif [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:2f:67,bridge_name='br-int',has_traffic_filtering=True,id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf923fe3-7d')
May 13 02:14:47.913008 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:47.913412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:47.913570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:47.933545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:47.933716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:47.949725 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:14:48.191589 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Detaching volume 8dbadb68-00fe-4ed7-917b-88010c33ca6f
May 13 02:14:48.284328 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to driver detach volume 8dbadb68-00fe-4ed7-917b-88010c33ca6f from mountpoint /dev/vdb
May 13 02:14:48.290517 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:48.291957 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:48.292172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Attempting to detach device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:14:48.292486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <alias name="ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f"/>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <serial>8dbadb68-00fe-4ed7-917b-88010c33ca6f</serial>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:48.292486 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:48.297839 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config.
May 13 02:14:48.298107 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] (1/8): Attempting to detach device vdb with device alias ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:14:48.298464 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <alias name="ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f"/>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <serial>8dbadb68-00fe-4ed7-917b-88010c33ca6f</serial>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:48.298464 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:48.326581 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:14:48.430107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:48.431468 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:48.437886 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Detaching volume af750f35-60f0-4440-a125-11ae45f4853a
May 13 02:14:48.494460 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Attempting to driver detach volume af750f35-60f0-4440-a125-11ae45f4853a from mountpoint /dev/vdb
May 13 02:14:48.508801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:48.509002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:48.513082 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:14:48.513766 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Claim successful on node np0000000663
May 13 02:14:48.530120 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '57b9a268-da0a-4f73-9b7f-68068852374f', 'attached_at': '', 'detached_at': '', 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'serial': 'af750f35-60f0-4440-a125-11ae45f4853a'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:14:48.535844 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-af750f35-60f0-4440-a125-11ae45f4853a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:48.538577 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-af750f35-60f0-4440-a125-11ae45f4853a {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:14:48.538705 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Attempting to detach device vdb from instance 57b9a268-da0a-4f73-9b7f-68068852374f from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:14:48.539855 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <alias name="ua-af750f35-60f0-4440-a125-11ae45f4853a"/>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <serial>af750f35-60f0-4440-a125-11ae45f4853a</serial>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:48.539855 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:48.549887 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 57b9a268-da0a-4f73-9b7f-68068852374f from the persistent domain config.
May 13 02:14:48.549887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] (1/8): Attempting to detach device vdb with device alias ua-af750f35-60f0-4440-a125-11ae45f4853a from instance 57b9a268-da0a-4f73-9b7f-68068852374f from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:14:48.549887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <alias name="ua-af750f35-60f0-4440-a125-11ae45f4853a"/>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <serial>af750f35-60f0-4440-a125-11ae45f4853a</serial>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:48.549887 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:14:48.863324 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638488.8628247, 96973110-5b6f-4469-8513-47e1f791fa60 => ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:14:48.864353 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8dbadb68-00fe-4ed7-917b-88010c33ca6f for instance 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:14:48.867787 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config.
May 13 02:14:48.869558 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:48.869558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:48.869558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:48.934601 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lazy-loading 'flavor' on Instance uuid 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:49.104500 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638489.103956, 57b9a268-da0a-4f73-9b7f-68068852374f => ua-af750f35-60f0-4440-a125-11ae45f4853a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:14:49.105657 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-af750f35-60f0-4440-a125-11ae45f4853a for instance 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:14:49.111118 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 57b9a268-da0a-4f73-9b7f-68068852374f from the live domain config.
May 13 02:14:49.111118 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:14:49.111118 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:14:49.111118 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:14:49.111118 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x705c6c166420>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '57b9a268-da0a-4f73-9b7f-68068852374f', 'attached_at': '', 'detached_at': '', 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'serial': 'af750f35-60f0-4440-a125-11ae45f4853a'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:14:49.111402 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.cryptsetup [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] closing encrypted volume /dev/dm-11 {{(pid=98103) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 13 02:14:49.146729 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:14:49.147017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:49.147230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:49.344336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799102 for multipath device dm-12 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:49.344754 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.060s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:49.345420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== connect_volume: return (6116ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799102', 'path': '/dev/dm-12', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799102'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:49.345592 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799102', 'path': '/dev/dm-12', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799102'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:49.345983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.432s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:49.346388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ccac6f30-47c4-4bca-9425-b817263826b4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:49.346533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:49.349527 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.382273 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [124] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.382954 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '123'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:49.382954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '123')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:49.384333 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4', '124')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:49.385660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c2416c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:49.385854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:14:49.386074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 33000000082533193 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:14:49.450851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:49.493412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:49.526450 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:14:49.526806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:14:49.527969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:14:49.541898 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:14:49.542153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:49.555915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.594299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.40.100,3260]
May 13 02:14:49.594299 np0000000663 nova-compute[98103]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.40.100,3260] successful.
May 13 02:14:49.594299 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.615599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.626870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.666166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.50.100,3260]
May 13 02:14:49.666166 np0000000663 nova-compute[98103]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-ccac6f30-47c4-4bca-9425-b817263826b4, portal: 192.168.50.100,3260] successful.
May 13 02:14:49.666166 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.688243 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.688507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:49.688660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (1774ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:49.688831 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:49.689617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.820s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:49.689911 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8dbadb68-00fe-4ed7-917b-88010c33ca6f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:49.690024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:49.691207 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Deleting instance files /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc_del
May 13 02:14:49.691986 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Deletion of /opt/stack/data/nova/instances/cf28a209-585f-43b9-9612-cc47883cdadc_del complete
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.727105 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [133] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [134] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:49.729499 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:49.730559 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '133'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:49.730559 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '133')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:49.734447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f', '134')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:49.737108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c4878e660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'): ({'sdj'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:49.737959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Removing multipathed devices sdc, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:14:49.737959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flush multipath device 330000000a04c93cb {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:14:49.773938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:49.822022 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:49.853389 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attempting to attach volume c978476a-a85c-44cd-ada6-eb5a6b8abdb8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:14:49.854685 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:   <alias name="ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8"/>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-12"/>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:   <serial>c978476a-a85c-44cd-ada6-eb5a6b8abdb8</serial>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:49.854685 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:14:49.862659 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if SCSI volumes sdc, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:14:49.862810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] SCSI volumes sdc, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:14:49.864119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if device paths {'sdc', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:14:49.876133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Device paths {'sdc', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:14:49.876358 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:49.889117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.932232 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.40.100,3260]
May 13 02:14:49.932232 np0000000663 nova-compute[98103]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.40.100,3260] successful.
May 13 02:14:49.932232 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.940607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:49.954683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:49.972892 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:14:49.973120 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:14:49.974698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.015478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.50.100,3260]
May 13 02:14:50.015478 np0000000663 nova-compute[98103]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-8dbadb68-00fe-4ed7-917b-88010c33ca6f, portal: 192.168.50.100,3260] successful.
May 13 02:14:50.015478 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.034689 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.034873 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:50.035027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== disconnect_volume: return (1165ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:50.035206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:50.040650 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.893s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:50.041325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'af750f35-60f0-4440-a125-11ae45f4853a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:14:50.044488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:50.073224 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:50.073460 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:50.073665 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-72f07b32-a7ed-4c00-bfa4-4959ce2f9d0f', '132'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:14:50.073665 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '135')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:50.074512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a', '136')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:14:50.075351 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48716700>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'): ({'sdl'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:14:50.075537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Removing multipathed devices sdk, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:14:50.075732 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flush multipath device 330000000baa20d19 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:14:50.114419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:50.162703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:14:50.199688 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Took 2.82 seconds to destroy the instance on the hypervisor.
May 13 02:14:50.199688 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:14:50.199688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:14:50.199816 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:14:50.200366 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:50.215355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:14:50.215553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:14:50.217055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:14:50.227952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:14:50.228185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:14:50.241508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.285496 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:50.292122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.40.100,3260]
May 13 02:14:50.292122 np0000000663 nova-compute[98103]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.40.100,3260] successful.
May 13 02:14:50.292122 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.311475 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.323902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.365617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.50.100,3260]
May 13 02:14:50.365617 np0000000663 nova-compute[98103]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-af750f35-60f0-4440-a125-11ae45f4853a, portal: 192.168.50.100,3260] successful.
May 13 02:14:50.365617 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.383019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:50.387780 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:50.387859 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== disconnect_volume: return (1240ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:50.388019 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:14:50.477127 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:14:50.603663 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:50.781916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-905d61fe-56c0-4874-9a3c-695bca2fc86c req-aecfbd7b-9d18-4328-8fab-d98166b45a44 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Received event network-vif-deleted-df923fe3-7d23-4205-9a8c-6b4bc62da7eb {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:50.782398 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-905d61fe-56c0-4874-9a3c-695bca2fc86c req-aecfbd7b-9d18-4328-8fab-d98166b45a44 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Neutron deleted interface df923fe3-7d23-4205-9a8c-6b4bc62da7eb; detaching it from the instance and deleting it from the info cache
May 13 02:14:50.782692 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-905d61fe-56c0-4874-9a3c-695bca2fc86c req-aecfbd7b-9d18-4328-8fab-d98166b45a44 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:50.794390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:50.940059 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:50.985817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.477s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:50.986457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:14:51.050320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:51.050517 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:51.050735 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Attaching volume 9e4bb5e8-dee7-46f8-845d-503203b07592 to /dev/vdb
May 13 02:14:51.091169 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:51.101982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:51.132312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:51.178013 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:51.178437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:51.187497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:51.190805 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fede:1dbf', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:51.190805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:51.190805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:51.190805 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:51.190805 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating existing volume attachment record: fd09e7b1-40f2-491c-8c76-2cab444c5028 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:51.218511 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:51.288086 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-905d61fe-56c0-4874-9a3c-695bca2fc86c req-aecfbd7b-9d18-4328-8fab-d98166b45a44 service nova] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Detach interface failed, port_id=df923fe3-7d23-4205-9a8c-6b4bc62da7eb, reason: Instance cf28a209-585f-43b9-9612-cc47883cdadc could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:14:51.492448 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:14:51.492739 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:14:51.493031 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:51.493357 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:51.526342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:51.526455 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:51.526579 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:51.526682 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:c0:4d:60, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:51.564593 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b8648b9097814fd5848d1e51cbecf9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0787f738661944129f59b1250bc5e71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:14:51.611467 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bec019bf-0836-40f1-be92-f190056e377e tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.924s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:51.721383 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Took 1.52 seconds to deallocate network for instance.
May 13 02:14:51.738868 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:51.739258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:51.739460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:51.740013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:51.740765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:51.755661 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:51.756408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:51.757174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:51.757623 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:51.758109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:51.758578 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:51.772361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:51.772361 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:51.777832 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:51.777832 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:51.785478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592] added
May 13 02:14:51.785478 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:51.785478 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:51.785478 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:51.785478 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:51.785478 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:51.785478 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:51.787013 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:51.787013 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:51.787013 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:51.791133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592] added
May 13 02:14:51.791133 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:51.791133 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:51.791133 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:51.791133 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:51.791133 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:51.791133 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:51.791415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:51.791684 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:51.791857 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:51.950998 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f5704d69-6720-4cc0-ad63-f9fa346d4d94 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.017s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:51.996568 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:14:52.124560 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Successfully created port: 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:14:52.284297 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:14:52.299553 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:52.299728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:52.299963 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:52.300217 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:52.300311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:52.303150 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Terminating instance
May 13 02:14:52.502377 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:14:52.693686 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Successfully updated port: 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:14:52.787487 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:52.792402 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:52.794510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:52.794999 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:52.801677 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:52.801677 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.808139 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:52.809323 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:52.809323 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.819074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.825117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.835191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.844761 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.852976 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.858040 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:52.864314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.872436 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.881651 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-changed-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:52.881651 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Refreshing instance network info cache due to event network-changed-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:14:52.881651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] Acquiring lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:52.881651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] Acquired lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:52.881651 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Refreshing network info cache for port 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:14:52.898181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.904317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.908384 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:52.923892 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.40.100,3260]
May 13 02:14:52.923892 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.40.100,3260] successful.
May 13 02:14:52.923892 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.938624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:52.971400 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,0 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:52.971764 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:52.971939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:52.972133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:52.974005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] HCTL ('9', '-', '-', 0) found on session 141 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:52.974157 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:52.991234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Searching for a device in session 141 and hctl ['9', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:52.991388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:53.011513 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Booting with volume f68e0c10-e63b-4db1-a0a9-bb391d150f76 at /dev/vda
May 13 02:14:53.048931 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:53.049552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:53.049792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:53.049876 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:53.050071 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] No waiting events found dispatching network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:53.050154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-30975b36-37ce-4ec4-864a-50a1d1895720 req-37b90885-7306-4b56-b94a-af4fb87d79d0 service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:14:53.073435 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:53.089423 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:53.119907 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-35e62978-4438-4027-882d-8390bae4809c tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.582s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:53.128526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:53.152609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.187488 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999349962999986 future=<Future at 0x705c6c28c050 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:53.188935 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Instance destroyed successfully.
May 13 02:14:53.190201 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'resources' on Instance uuid 57b9a268-da0a-4f73-9b7f-68068852374f {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:53.191155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:53.191890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:53.199868 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:14:53.213979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:53.215539 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:53.215721 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:53.215854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:53.216522 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:53.216825 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating existing volume attachment record: b76e201e-d06a-459d-91b7-185fd23c5850 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:53.300826 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:53.301024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:53.387549 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:53.390835 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:14:53.391838 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:14:53.460508 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:14:53.604192 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:53.692304 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1297776828',display_name='tempest-TestEncryptedCinderVolumes-server-1297776828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1297776828',id=56,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf0wvTDga1iEFE6DtKjjhj0Z11bKXFgbcyGhtalIOXGofGCNOEYuYG/4D2MrErQ34drNBVijXQ26FXl7vEFsi7KAW47dAsqTljW69HCmPBa+8JaACSJtSU8uQq+7YuS5g==',key_name='tempest-keypair-1864197042',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:13:58Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-6k8p0qyq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=57b9a268-da0a-4f73-9b7f-68068852374f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:14:53.692486 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "address": "fa:16:3e:de:1d:bf", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea775620-9d", "ovs_interfaceid": "ea775620-9d16-43bb-9d8e-7d8e589b9a29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:53.693114 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:53.693497 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:14:53.695459 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.695802 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea775620-9d, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:53.696751 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.697609 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:53.697913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.698817 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.698982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bb6f275-92c0-4cf2-ba7c-622690adddc7) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:53.699594 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.700103 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:53.700800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:53.702823 np0000000663 nova-compute[98103]: INFO os_vif [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:1d:bf,bridge_name='br-int',has_traffic_filtering=True,id=ea775620-9d16-43bb-9d8e-7d8e589b9a29,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea775620-9d')
May 13 02:14:53.703044 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Deleting instance files /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f_del
May 13 02:14:53.703830 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Deletion of /opt/stack/data/nova/instances/57b9a268-da0a-4f73-9b7f-68068852374f_del complete
May 13 02:14:53.810184 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:53.894238 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:14:53.911554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.50.100,3260]
May 13 02:14:53.911554 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.50.100,3260] successful.
May 13 02:14:53.911554 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:53.924729 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:53.942468 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:53.942740 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:53.943800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.186s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:53.944125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:53.945058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] HCTL ('8', '-', '-', 0) found on session 140 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:53.945234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:53.959334 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Searching for a device in session 140 and hctl ['8', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:54.107216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7582ca5f-e2c5-4b18-9c7a-11142f5d1f96 req-5756080f-07e6-43d7-a3ce-52b55f77576a service nova] Releasing lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:54.108489 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquired lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:14:54.108612 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:14:54.210113 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 02:14:54.210743 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:14:54.211037 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:14:54.211191 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:14:54.211444 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:54.272966 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:54.405042 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.610s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:54.448927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:54.449128 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:54.487997 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance cf28a209-585f-43b9-9612-cc47883cdadc
May 13 02:14:54.729586 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:14:54.816619 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:54.909777 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:14:54.952899 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:54.962680 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Searching for a device in session 140 and hctl ['8', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:54.962872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:55.109084 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating instance_info_cache with network_info: [{"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:55.126362 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2580d5d2-59c0-49d0-9dcf-46d0676db4d8 req-5b4fa490-20a0-46c4-a5ab-c018663e728e service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-deleted-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:55.126656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-2580d5d2-59c0-49d0-9dcf-46d0676db4d8 req-5b4fa490-20a0-46c4-a5ab-c018663e728e service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Neutron deleted interface ea775620-9d16-43bb-9d8e-7d8e589b9a29; detaching it from the instance and deleting it from the info cache
May 13 02:14:55.126656 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2580d5d2-59c0-49d0-9dcf-46d0676db4d8 req-5b4fa490-20a0-46c4-a5ab-c018663e728e service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:55.153680 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:14:55.153970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] Acquiring lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:55.153970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:55.154116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] Lock "57b9a268-da0a-4f73-9b7f-68068852374f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:55.154426 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] No waiting events found dispatching network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:14:55.154426 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c15e5989-2c44-4db7-8c1d-c2bf052f41d4 req-7e2f3d44-00ce-42bb-8ef4-e543080503da service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Received event network-vif-unplugged-ea775620-9d16-43bb-9d8e-7d8e589b9a29 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:14:55.248758 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:14:55.352289 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:14:55.353217 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:14:55.353462 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Creating image(s)
May 13 02:14:55.353846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:14:55.354187 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Ensure instance console log exists: /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:14:55.354277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:55.354473 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:55.354631 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:55.496630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8325b418-e5da-4922-96f3-55d63d9f4359 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "cf28a209-585f-43b9-9612-cc47883cdadc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.624s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:55.611067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Releasing lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:14:55.612918 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance network_info: |[{"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:14:55.612918 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Start _get_guest_xml network_info=[{"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b98bc978-d744-41a3-b579-17dc08777b8d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'serial': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76'}, 'attachment_id': 'b76e201e-d06a-459d-91b7-185fd23c5850', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:14:55.615863 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:14:55.617708 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-2036478889', uuid='b98bc978-d744-41a3-b579-17dc08777b8d'), owner=OwnerMeta(userid='b8648b9097814fd5848d1e51cbecf9a6', username='tempest-TestVolumeBootPatternV346-1111989009-project-member', projectid='0787f738661944129f59b1250bc5e71e', projectname='tempest-TestVolumeBootPatternV346-1111989009'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638495.6169171) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:14:55.622722 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:14:55.622722 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:14:55.625044 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:14:55.628115 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:14:55.628624 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:14:55.629386 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:14:55.629666 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:14:55.636331 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2580d5d2-59c0-49d0-9dcf-46d0676db4d8 req-5b4fa490-20a0-46c4-a5ab-c018663e728e service nova] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Detach interface failed, port_id=ea775620-9d16-43bb-9d8e-7d8e589b9a29, reason: Instance 57b9a268-da0a-4f73-9b7f-68068852374f could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:14:55.644994 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:55.645462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:55.645758 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:55.751543 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Took 1.54 seconds to deallocate network for instance.
May 13 02:14:55.803352 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:55.808747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799107 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:55.809060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.069s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:55.809310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] <== connect_volume: return (4069ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799107', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799107'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:55.809434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799107', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799107'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:55.810436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.165s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:55.810630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:55.816412 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lazy-loading 'flavor' on Instance uuid 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:55.827524 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:55.827649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:55.828820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:55.830321 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:55.830321 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:55.830321 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:55.845932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:55.845932 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:55.850924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:55.850924 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:55.860451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76] added
May 13 02:14:55.860451 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:55.860451 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:55.860451 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:55.860451 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:55.860451 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:55.860451 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:55.862212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:55.862212 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0319(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:55.862212 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:55.866129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76] added
May 13 02:14:55.866129 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:55.866129 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:55.866129 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:55.866129 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:55.866129 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:55.866129 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:55.866486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:55.866598 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:55.866827 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:55.886447 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:55.886792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:55.887047 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attaching volume e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 to /dev/vdb
May 13 02:14:55.933965 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:55.946857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:55.957704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:55.972734 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:56.019281 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:56.019718 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:56.029449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:56.031044 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:56.031240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:56.031382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:56.031686 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:56.031978 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating existing volume attachment record: d8b1ac87-ee41-4534-a229-def92bfa0d40 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:56.257601 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:56.257890 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:56.322570 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Attempting to attach volume 9e4bb5e8-dee7-46f8-845d-503203b07592 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:14:56.325086 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:   <alias name="ua-9e4bb5e8-dee7-46f8-845d-503203b07592"/>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:   <serial>9e4bb5e8-dee7-46f8-845d-503203b07592</serial>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]: </disk>
May 13 02:14:56.325086 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:14:56.593343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:56.593630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:56.593792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:56.691334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:14:56.691577 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:14:56.861533 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:56.867254 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:56.878184 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:56.878184 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:56.885434 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:56.885434 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005506819998117862 future=<Future at 0x705c6c77f440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.298987277999913 future=<Future at 0x705c6c28c050 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.298861934999877 future=<Future at 0x705c6c28c050 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Emitting event <LifecycleEvent: 1778638481.8858836, cf28a209-585f-43b9-9612-cc47883cdadc => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:14:56.888735 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] VM Stopped (Lifecycle Event)
May 13 02:14:56.892759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.906076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.916552 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.926743 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:56.927017 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:56.970235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.40.100,3260]
May 13 02:14:56.970235 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.40.100,3260] successful.
May 13 02:14:56.970235 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.981893 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:56.982658 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.50.100,3260]
May 13 02:14:56.982658 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.50.100,3260] successful.
May 13 02:14:56.982658 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:57.000044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.007986 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.008370 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:57.008627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:57.008926 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:57.011438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('11', '-', '-', 0) found on session 142 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:57.011630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.023079 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:57.023425 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:57.023704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:57.024037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:14:57.025069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] HCTL ('12', '-', '-', 0) found on session 143 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:14:57.025621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:14:57.032999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 142 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:57.033355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:57.046138 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 143 and hctl ['12', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:57.063226 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:57.063511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:57.063758 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attaching volume c868cceb-3a30-43ca-9caa-d155c4869fc7 to /dev/vdc
May 13 02:14:57.105224 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:57.116801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:14:57.158720 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:14:57.197676 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:14:57.210306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:14:57.210731 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:14:57.221452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:14:57.223069 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305'] 
May 13 02:14:57.223371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:14:57.223452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:14:57.223814 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:57.224079 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating existing volume attachment record: 1768054c-3cc0-4632-abe0-a60114789fb6 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:14:57.393111 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0c32e63c-eacc-4ef9-b5e3-a71854267f19 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: cf28a209-585f-43b9-9612-cc47883cdadc] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:14:57.712961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.455s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:57.773388 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deleted allocations for instance 57b9a268-da0a-4f73-9b7f-68068852374f
May 13 02:14:57.787354 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:14:57.788031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:14:57.788031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:57.886628 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 02:14:58.009106 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:58.009937 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:58.009937 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:14:58.009937 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] No VIF found with MAC fa:16:3e:04:5d:30, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:14:58.044307 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Searching for a device in session 143 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:14:58.044522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:14:58.388949 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] There are 0 instances to clean {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 02:14:58.389181 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:14:58.700678 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:58.783910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e56db6d5-fa6f-47bd-a081-b4cc10411935 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "57b9a268-da0a-4f73-9b7f-68068852374f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.484s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:58.849200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Found WWN 3300000003c64c638 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:14:58.849715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:14:58.850063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== connect_volume: return (3204ms) {'type': 'block', 'scsi_wwn': '3300000003c64c638', 'path': '/dev/dm-4', 'multipath_id': '3300000003c64c638'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:14:58.850289 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003c64c638', 'path': '/dev/dm-4', 'multipath_id': '3300000003c64c638'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:14:58.850775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.257s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:58.851207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:14:58.865048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:58.865800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:14:58.866495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:58.866722 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:58.867864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:14:58.867864 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:58.880745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:58.880745 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:58.882955 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:14:58.882955 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:58.894913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0] added
May 13 02:14:58.894913 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:58.894913 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:58.894913 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:58.894913 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:58.894913 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:58.894913 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:58.895591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:58.895591 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0285(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:58.895591 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:58.898592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0] added
May 13 02:14:58.898592 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:14:58.898592 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:58.898592 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:58.898592 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:14:58.898592 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:14:58.898592 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:58.898865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:14:58.898865 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:14:58.899045 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:14:59.357614 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2036478889',display_name='tempest-TestVolumeBootPatternV346-server-2036478889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-2036478889',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNekVnf5kkjAKMOZTtTZq9wn037/DSkP0RdP6LgND/IHVKZcKNdaA/0adWpN+UdMaGxDCAMRJtPJeX9271ojMh8TeTtZZ8b3zeBlGVrg2elrblMP2vIL8VXmqtedkySw==',key_name='tempest-keypair-1210820551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-dhpcj88v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=b98bc978-d744-41a3-b579-17dc08777b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:14:59.357899 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:59.358439 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:59.359490 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'pci_devices' on Instance uuid b98bc978-d744-41a3-b579-17dc08777b8d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:14:59.387858 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:59.388210 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:59.388605 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:14:59.564606 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d95151c4-fe94-4381-9e92-a10bc18dfcc0 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.514s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:59.862080 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] End _get_guest_xml xml=<domain type="qemu">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <uuid>b98bc978-d744-41a3-b579-17dc08777b8d</uuid>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <name>instance-0000003b</name>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPatternV346-server-2036478889</nova:name>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:14:55</nova:creationTime>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:user uuid="b8648b9097814fd5848d1e51cbecf9a6">tempest-TestVolumeBootPatternV346-1111989009-project-member</nova:user>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:project uuid="0787f738661944129f59b1250bc5e71e">tempest-TestVolumeBootPatternV346-1111989009</nova:project>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         <nova:port uuid="65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <system>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="serial">b98bc978-d744-41a3-b579-17dc08777b8d</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="uuid">b98bc978-d744-41a3-b579-17dc08777b8d</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </system>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <os>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </os>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <features>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </features>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   <devices>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/disk.config"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </disk>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <alias name="ua-f68e0c10-e63b-4db1-a0a9-bb391d150f76"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-4"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <serial>f68e0c10-e63b-4db1-a0a9-bb391d150f76</serial>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </disk>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:83:ac:7f"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <target dev="tap65ba8fa8-d1"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </interface>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/console.log" append="off"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </serial>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <video>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </video>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </rng>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:   </devices>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]: </domain>
May 13 02:14:59.862080 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Preparing to wait for external event network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2036478889',display_name='tempest-TestVolumeBootPatternV346-server-2036478889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-2036478889',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNekVnf5kkjAKMOZTtTZq9wn037/DSkP0RdP6LgND/IHVKZcKNdaA/0adWpN+UdMaGxDCAMRJtPJeX9271ojMh8TeTtZZ8b3zeBlGVrg2elrblMP2vIL8VXmqtedkySw==',key_name='tempest-keypair-1210820551',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-dhpcj88v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=b98bc978-d744-41a3-b579-17dc08777b8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:14:59.863971 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:14:59.864333 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:14:59.864333 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:14:59.864559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.864777 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:59.865032 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:14:59.865804 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.865948 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '434248b8-4fdc-585c-a8ba-08bb96ab2a76', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:59.866750 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.867419 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:59.867823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.871788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.871788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65ba8fa8-d1, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:59.871788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65ba8fa8-d1, col_values=(('qos', UUID('23342872-8269-4a38-a833-0ba4e9428de2')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:59.871788 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65ba8fa8-d1, col_values=(('external_ids', {'iface-id': '65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:ac:7f', 'vm-uuid': 'b98bc978-d744-41a3-b579-17dc08777b8d'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:14:59.872380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.873515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:14:59.881883 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:14:59.882984 np0000000663 nova-compute[98103]: INFO os_vif [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1')
May 13 02:14:59.884354 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:59.884554 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:14:59.896056 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:14:59.900243 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:59.909576 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:59.909576 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:14:59.915264 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:14:59.915264 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:59.923597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:59.929491 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.945616 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.945945 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.951842 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:14:59.952406 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:00.002445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.40.100,3260]
May 13 02:15:00.002445 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.40.100,3260] successful.
May 13 02:15:00.002445 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:00.014494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.50.100,3260]
May 13 02:15:00.014494 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.50.100,3260] successful.
May 13 02:15:00.014494 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:00.020503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:00.029170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.040778 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.041456 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:00.041792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:00.041792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:00.043336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('15', '-', '-', 0) found on session 144 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:00.043452 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:00.055647 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:00.055647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:00.056263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('16', '-', '-', 0) found on session 145 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:00.056263 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:00.065356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 144 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:00.065537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:00.075419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 145 and hctl ['16', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:00.386600 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:15:00.691581 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:00.691748 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:01.076267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 145 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:01.076267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:01.194007 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Detaching volume 9e4bb5e8-dee7-46f8-845d-503203b07592
May 13 02:15:01.234245 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Attempting to driver detach volume 9e4bb5e8-dee7-46f8-845d-503203b07592 from mountpoint /dev/vdb
May 13 02:15:01.242346 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Found disk vdb by alias ua-9e4bb5e8-dee7-46f8-845d-503203b07592 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:01.244116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Found disk vdb by alias ua-9e4bb5e8-dee7-46f8-845d-503203b07592 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:01.244295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Attempting to detach device vdb from instance 5aedc303-4005-4670-a46c-81accc9a0101 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:15:01.244508 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <alias name="ua-9e4bb5e8-dee7-46f8-845d-503203b07592"/>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <serial>9e4bb5e8-dee7-46f8-845d-503203b07592</serial>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:01.244508 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:01.253368 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Successfully detached device vdb from instance 5aedc303-4005-4670-a46c-81accc9a0101 from the persistent domain config.
May 13 02:15:01.253625 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] (1/8): Attempting to detach device vdb with device alias ua-9e4bb5e8-dee7-46f8-845d-503203b07592 from instance 5aedc303-4005-4670-a46c-81accc9a0101 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:15:01.253935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <alias name="ua-9e4bb5e8-dee7-46f8-845d-503203b07592"/>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <serial>9e4bb5e8-dee7-46f8-845d-503203b07592</serial>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:01.253935 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:01.272591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:01.273539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:01.386295 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:15:01.386534 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances with incomplete migration  {{(pid=98103) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 02:15:01.400798 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:01.400936 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:01.401058 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] No VIF found with MAC fa:16:3e:83:ac:7f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:01.401840 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Using config drive
May 13 02:15:01.776640 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:15:01.844655 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638501.8441064, 5aedc303-4005-4670-a46c-81accc9a0101 => ua-9e4bb5e8-dee7-46f8-845d-503203b07592> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:15:01.846425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9e4bb5e8-dee7-46f8-845d-503203b07592 for instance 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:15:01.851776 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Successfully detached device vdb from instance 5aedc303-4005-4670-a46c-81accc9a0101 from the live domain config.
May 13 02:15:01.853311 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:01.854238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:01.854381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:01.885070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found WWN 330000000f54dfed4 for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:15:01.885594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:01.885808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== connect_volume: return (5292ms) {'type': 'block', 'scsi_wwn': '330000000f54dfed4', 'path': '/dev/dm-10', 'multipath_id': '330000000f54dfed4'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:01.886283 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f54dfed4', 'path': '/dev/dm-10', 'multipath_id': '330000000f54dfed4'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:15:01.887774 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.100s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:01.888396 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:15:01.889839 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:15:01.890438 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:01.901649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:01.902536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:01.902647 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:01.903436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:01.908365 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:01.911017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:01.911387 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:01.917117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:01.917117 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:01.927989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:01.927989 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:01.931178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7] added
May 13 02:15:01.931178 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:01.931178 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:01.931178 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:01.931178 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:01.931178 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:01.931178 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:01.931521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:01.931669 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:01.931883 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:01.941248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7] added
May 13 02:15:01.941248 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:01.941248 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:01.941248 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:01.941248 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:01.941248 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:01.941248 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:01.941574 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:01.941621 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:01.941798 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:02.048644 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Creating config drive at /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/disk.config
May 13 02:15:02.054005 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsis1anmp {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:02.114173 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsis1anmp" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:02.337378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:02.337659 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:02.347867 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:15:02.348067 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Claim successful on node np0000000663
May 13 02:15:02.387817 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:15:02.394724 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to attach volume e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:15:02.396523 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:15:02.398517 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:   <alias name="ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0"/>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:   <serial>e6c51d2f-8f97-4246-bbc6-5da0dd02eae0</serial>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:02.398517 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:15:02.663895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:02.695662 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:02.804844 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:02.815075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:02.816852 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:02.881516 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-89d9b42b-80fe-48cc-b923-846ab8f37d54 req-5e4159b8-3591-46d1-aec6-fd561e59878f service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:02.885728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-89d9b42b-80fe-48cc-b923-846ab8f37d54 req-5e4159b8-3591-46d1-aec6-fd561e59878f service nova] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:02.886013 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-89d9b42b-80fe-48cc-b923-846ab8f37d54 req-5e4159b8-3591-46d1-aec6-fd561e59878f service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:02.886338 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-89d9b42b-80fe-48cc-b923-846ab8f37d54 req-5e4159b8-3591-46d1-aec6-fd561e59878f service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:02.886831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-89d9b42b-80fe-48cc-b923-846ab8f37d54 req-5e4159b8-3591-46d1-aec6-fd561e59878f service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Processing event network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:15:02.907277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:02.932447 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:02.942239 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:02.949851 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:02.949851 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:02.958686 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:02.958686 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:02.967534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:02.973657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.994105 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.996566 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.996999 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:02.997453 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:03.049430 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.50.100,3260]
May 13 02:15:03.049430 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.50.100,3260] successful.
May 13 02:15:03.049430 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:03.058863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.40.100,3260]
May 13 02:15:03.058863 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.40.100,3260] successful.
May 13 02:15:03.058863 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:03.065704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:03.071293 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.088016 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.088419 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:03.088700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:03.088780 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:03.090716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('17', '-', '-', 0) found on session 146 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:03.090845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.097828 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:03.098643 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:03.098643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:03.099830 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] HCTL ('21', '-', '-', 0) found on session 147 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:03.099968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:03.106130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 146 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:03.106130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:03.113989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Searching for a device in session 147 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:03.113989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:03.187938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:03.188306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:03.593305 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638503.5928578, b98bc978-d744-41a3-b579-17dc08777b8d => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:03.594349 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:15:03.594698 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] VM Started (Lifecycle Event)
May 13 02:15:03.597588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:15:03.602672 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance spawned successfully.
May 13 02:15:03.603418 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:15:03.690134 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:15:03.807894 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:03.808205 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:03.904266 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:15:04.097243 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:04.100110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:04.103945 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:04.104127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:04.104343 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:04.104487 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No VIF found with MAC fa:16:3e:58:af:b7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:04.117296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.117296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.117676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.117709 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.117996 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.118310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:04.238986 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:04.311002 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:04.603046 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:15:04.603314 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638504.6030328, b98bc978-d744-41a3-b579-17dc08777b8d => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:04.603475 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] VM Paused (Lifecycle Event)
May 13 02:15:04.624920 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Took 9.27 seconds to spawn the instance on the hypervisor.
May 13 02:15:04.624920 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:04.818686 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.481s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:04.819045 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:15:04.821848 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.915s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:04.822009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:04.822227 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:15:04.823693 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.585s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:04.830684 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:15:04.830842 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Claim successful on node np0000000663
May 13 02:15:04.874582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:04.926327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found WWN 330000000af83b38e for multipath device dm-11 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:15:04.926668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:04.926919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== connect_volume: return (7139ms) {'type': 'block', 'scsi_wwn': '330000000af83b38e', 'path': '/dev/dm-11', 'multipath_id': '330000000af83b38e'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:04.927157 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000af83b38e', 'path': '/dev/dm-11', 'multipath_id': '330000000af83b38e'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:15:04.928644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.074s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:04.929103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e4bb5e8-dee7-46f8-845d-503203b07592', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:04.929338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:04.931448 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:04.970515 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:04.970952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:04.971431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:04.971431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:04.971569 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] No waiting events found dispatching network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:04.971621 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-820422d1-cd99-4d59-a395-6c0e131d75a9 req-7fbe6871-0967-418d-8b5a-093f7afb6449 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received unexpected event network-vif-plugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 for instance with vm_state active and task_state None.
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:04.975503 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:04.975875 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:04.976207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '147')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:04.976207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', '141')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:04.979524 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592', '140')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:04.981041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487149a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'): ({'sdd'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:04.981189 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Removing multipathed devices sdd, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:04.981482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Flush multipath device 330000000c842640f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:05.023082 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:05.068230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:05.105937 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:05.107764 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638505.1075575, b98bc978-d744-41a3-b579-17dc08777b8d => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:05.107922 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] VM Resumed (Lifecycle Event)
May 13 02:15:05.115249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:05.115500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:05.117268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:05.127439 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:05.127681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:05.136306 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Took 16.68 seconds to build instance.
May 13 02:15:05.141989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.192906 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.40.100,3260]
May 13 02:15:05.192906 np0000000663 nova-compute[98103]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.40.100,3260] successful.
May 13 02:15:05.192906 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.221371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.235720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.274461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.50.100,3260]
May 13 02:15:05.274461 np0000000663 nova-compute[98103]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-9e4bb5e8-dee7-46f8-845d-503203b07592, portal: 192.168.50.100,3260] successful.
May 13 02:15:05.274461 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.296701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:05.296956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:05.297080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] <== disconnect_volume: return (3442ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:05.297275 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:05.330262 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:15:05.330262 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:15:05.330262 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:05.330262 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:05.432310 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:15:05.436540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attempting to attach volume c868cceb-3a30-43ca-9caa-d155c4869fc7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:15:05.438391 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:   <alias name="ua-c868cceb-3a30-43ca-9caa-d155c4869fc7"/>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:   <serial>c868cceb-3a30-43ca-9caa-d155c4869fc7</serial>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:05.438391 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:15:05.610697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:05.616050 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:05.637888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef796ca5-abac-4e3a-beff-81303f8bf29f tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:05.660317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-389d86b4-f0a8-4786-8bc3-c30f7b5231a2 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.773s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:05.816036 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:05.832870 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:15:05.856023 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lazy-loading 'flavor' on Instance uuid 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:05.882625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.008782 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.009424 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.069430 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Successfully created port: 059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:15:06.096669 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Refreshing inventories for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 02:15:06.125241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.136195 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.196641 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Updating ProviderTree inventory for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 02:15:06.196902 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:15:06.237010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.237701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.265263 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Refreshing aggregate associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, aggregates: None {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 02:15:06.340532 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:15:06.346956 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Refreshing trait associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, traits: COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ARCH_AARCH64,HW_CPU_X86_MMX,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_MIPSEL,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 02:15:06.364674 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.366392 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.371867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.375216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.376968 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.503862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.504540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.629747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.632822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-12 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.632822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-11 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.640546 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:15:06.648816 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:15:06.650350 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:06.714984 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:06.719376 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Successfully updated port: 059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:15:06.721485 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12083MB free_disk=72.87326431274414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:15:06.721751 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:06.853125 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Booting with volume 426820d4-748c-4053-9d82-e2d0681ee491 at /dev/vda
May 13 02:15:06.868781 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-04d7da88-3b4d-4873-9655-c64fb199024b tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.177s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:06.910339 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:06.922702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:15:06.947790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:06.948104 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:06.955120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:07.007680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:15:07.008858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:15:07.024057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:15:07.024057 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fec0:4d60', 'fe80::3484:12ff:fe29:39e5', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe04:5d30', 'fe80::186f:5ff:fe84:8305', 'fe80::fc16:3eff:fe83:ac7f'] 
May 13 02:15:07.024057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:15:07.025509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:15:07.025933 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:07.026384 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating existing volume attachment record: 9e7c9717-68ff-4565-93b4-a8d0f21f3937 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:15:07.034326 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-changed-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:07.034505 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Refreshing instance network info cache due to event network-changed-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:07.034755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] Acquiring lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:07.035812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] Acquired lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:07.039515 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Refreshing network info cache for port 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:07.045324 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-changed-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:07.045520 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Refreshing instance network info cache due to event network-changed-059fb0c1-9865-4348-bf5f-8056dbe21fbf. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:07.045520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] Acquiring lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:07.045520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] Acquired lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:07.045520 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Refreshing network info cache for port 059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:07.136062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:07.136062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:07.136062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:07.136062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:07.136372 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] No VIF found with MAC fa:16:3e:c0:4d:60, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:07.239679 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:07.452018 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:07.542930 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:07.548468 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:07.642341 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:15:07.871775 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:07.962198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.138s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:07.962790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:15:07.967145 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.245s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:07.976381 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:08.161879 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updated VIF entry in instance network info cache for port 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:15:08.162224 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating instance_info_cache with network_info: [{"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:08.186949 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0010704570004236302 future=<Future at 0x705c6c28c050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:08.187454 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:08.188375 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638493.1857443, 57b9a268-da0a-4f73-9b7f-68068852374f => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:08.188646 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] VM Stopped (Lifecycle Event)
May 13 02:15:08.303595 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:08.303948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:08.304230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:08.304410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:08.304571 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:08.307644 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Terminating instance
May 13 02:15:08.374842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f0a0cdf0-f17f-40e2-8a98-96018b59852b req-d28df1e5-6b70-41eb-bfed-3cf0d4f285cd service nova] Releasing lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:08.375142 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:08.375439 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:15:08.477054 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:15:08.483075 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:15:08.483075 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:08.483380 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:08.598084 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63c9dc09e45e4cdeb438d163532a8849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4cdaf6da19497586ec83765be014b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:15:08.667526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b3aa90d2-a2da-4180-bbac-65cf6391ceca req-316bd933-7fa4-432d-b1f0-c773827983ea service nova] Releasing lock "refresh_cache-b98bc978-d744-41a3-b579-17dc08777b8d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:08.695383 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-12403fbc-625e-43f6-b23a-34598106df9e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 57b9a268-da0a-4f73-9b7f-68068852374f] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:08.703999 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3ae942e6-6920-4c12-9a69-ad583039b0ae tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.640s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:08.816492 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:15:08.837761 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:08.851126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:08.866022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:08.874021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:08.902916 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:08.972131 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:15:08.996837 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:15:09.083832 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance acca535f-2ccf-44dc-b45b-1587bcc4561a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.083974 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 96973110-5b6f-4469-8513-47e1f791fa60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084048 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance fd054b4f-181b-44ac-8e14-86ea3659208c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084167 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084256 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5aedc303-4005-4670-a46c-81accc9a0101 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084365 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance b98bc978-d744-41a3-b579-17dc08777b8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084562 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 40182305-b217-4ea3-bb1a-09b673321381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.084614 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:15:09.085204 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:15:09.085338 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:15:06 up 39 min,  2 users,  load average: 6.21, 7.45, 5.13\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_0787f738661944129f59b1250bc5e71e': '3', 'io_workload': '2', 'num_proj_870689e5ef3f426395f7245076bf7085': '1', 'num_proj_c97b10a192fd43f689e55b4537a4f824': '1', 'num_task_deleting': '1', 'num_proj_9cf8b3ecad8f412ca2c2c93812300766': '1', 'num_vm_building': '2', 'num_task_block_device_mapping': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1', 'num_proj_cf4cdaf6da19497586ec83765be014b7': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:15:09.172533 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:15:09.173628 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:15:09.173883 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Creating image(s)
May 13 02:15:09.175642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:15:09.175642 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Ensure instance console log exists: /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:15:09.175642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:09.175642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:09.175642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:09.177313 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999714649999987 future=<Future at 0x705c486f0410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:09.177963 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999087344000145 future=<Future at 0x705c486f0410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:09.178206 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998941683999874 future=<Future at 0x705c486f0410 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:09.182334 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Instance destroyed successfully.
May 13 02:15:09.183677 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lazy-loading 'resources' on Instance uuid 5aedc303-4005-4670-a46c-81accc9a0101 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:09.192469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:09.192942 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:09.192942 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:09.193328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:09.193328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] No waiting events found dispatching network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:09.193510 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ef969d1-eade-4581-8fb9-f692e0ec5cce req-522beae2-17bf-4820-8e44-374bb657b8fd service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:09.246825 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:09.433638 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:09.467463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:09.467463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:09.478111 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Successfully created port: 9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:15:09.509003 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:15:09.558977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:09.559164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:09.630482 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:09.630686 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:09.689990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-142287336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachscenariooldversion-server-1422873',id=58,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ufy1F9ekjoIlDEJZZ5kBgeoaIfNkqktBEDvVNW5bH/ADpLyYL4z+LxiSjChBJJKOBJn5YQ3o1sQVfvaxALynlZri4PSy0iUJr9OPXAyr25lBzYFmN06ujgQSTzt1Myg==',key_name='tempest-keypair-1213102951',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:14:08Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cf8b3ecad8f412ca2c2c93812300766',ramdisk_id='',reservation_id='r-qfk150cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:14:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5290d2441ac241dfb13a0164caffbbe2',uuid=5aedc303-4005-4670-a46c-81accc9a0101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:15:09.690186 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converting VIF {"id": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "address": "fa:16:3e:04:5d:30", "network": {"id": "5ebf4285-6ecc-4408-8e07-5cc8404915c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1601178303-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9cf8b3ecad8f412ca2c2c93812300766", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapceee96c6-5c", "ovs_interfaceid": "ceee96c6-5ccb-4279-83dc-7205a74794e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:09.690710 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:09.690908 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:15:09.691974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.692205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapceee96c6-5c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:09.694473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.694473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:09.694473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.694737 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.694879 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d71dcb36-6e92-456d-b1b3-a0cb2bd1fd91) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:09.696340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.696340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:09.696340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:09.697637 np0000000663 nova-compute[98103]: INFO os_vif [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:5d:30,bridge_name='br-int',has_traffic_filtering=True,id=ceee96c6-5ccb-4279-83dc-7205a74794e2,network=Network(5ebf4285-6ecc-4408-8e07-5cc8404915c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapceee96c6-5c')
May 13 02:15:09.697878 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Deleting instance files /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101_del
May 13 02:15:09.698596 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Deletion of /opt/stack/data/nova/instances/5aedc303-4005-4670-a46c-81accc9a0101_del complete
May 13 02:15:09.936838 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:09.937221 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance network_info: |[{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:15:09.937867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start _get_guest_xml network_info=[{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '40182305-b217-4ea3-bb1a-09b673321381', 'attached_at': '', 'detached_at': '', 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'serial': '426820d4-748c-4053-9d82-e2d0681ee491'}, 'attachment_id': '9e7c9717-68ff-4565-93b4-a8d0f21f3937', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:15:09.941516 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:15:09.942755 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1493331219', uuid='40182305-b217-4ea3-bb1a-09b673321381'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638509.9423811) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:15:09.944185 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:15:09.944562 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:15:09.945568 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:15:09.945741 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:15:09.946740 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:15:09.947034 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:15:09.947233 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:15:09.947345 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:15:09.947505 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:15:09.948579 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:15:09.961585 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:15:09.961995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:09.962226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:09.969655 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Detaching volume c978476a-a85c-44cd-ada6-eb5a6b8abdb8
May 13 02:15:09.993494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.031s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:09.993727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:15:10.006771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:10.007578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:10.008230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:10.008504 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:10.008966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:10.012112 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:10.023687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:10.023687 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:10.032258 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attempting to driver detach volume c978476a-a85c-44cd-ada6-eb5a6b8abdb8 from mountpoint /dev/vdb
May 13 02:15:10.036030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:10.036030 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:10.043218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdb by alias ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:10.044282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491] added
May 13 02:15:10.044282 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:10.044282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:10.044282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:10.044282 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:10.044282 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:10.044282 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:10.044600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:10.044835 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:10.044987 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:10.047194 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdb by alias ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:10.047310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Attempting to detach device vdb from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:15:10.047535 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <alias name="ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8"/>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-12"/>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <serial>c978476a-a85c-44cd-ada6-eb5a6b8abdb8</serial>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:10.047535 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491] added
May 13 02:15:10.053851 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:10.053851 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:10.053851 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:10.060479 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdb from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the persistent domain config.
May 13 02:15:10.060709 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] (1/8): Attempting to detach device vdb with device alias ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:15:10.060985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <alias name="ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8"/>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-12"/>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <serial>c978476a-a85c-44cd-ada6-eb5a6b8abdb8</serial>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:10.060985 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:10.064344 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Detaching volume e6c51d2f-8f97-4246-bbc6-5da0dd02eae0
May 13 02:15:10.073568 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Successfully updated port: 9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:15:10.134106 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:10.140578 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to driver detach volume e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 from mountpoint /dev/vdb
May 13 02:15:10.142295 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-changed-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:10.142295 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Refreshing instance network info cache due to event network-changed-9323fc02-c359-4327-a3d9-14269b62beae. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:10.142295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] Acquiring lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:10.142445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] Acquired lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:10.142445 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Refreshing network info cache for port 9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:10.155043 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:10.156660 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:10.156911 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Attempting to detach device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:15:10.157246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <alias name="ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0"/>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <serial>e6c51d2f-8f97-4246-bbc6-5da0dd02eae0</serial>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:10.157246 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:10.164792 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config.
May 13 02:15:10.164942 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] (1/8): Attempting to detach device vdb with device alias ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:15:10.165213 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <alias name="ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0"/>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <serial>e6c51d2f-8f97-4246-bbc6-5da0dd02eae0</serial>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:10.165213 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:10.205110 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Took 1.39 seconds to destroy the instance on the hypervisor.
May 13 02:15:10.205772 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:15:10.206570 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:15:10.206681 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:15:10.206938 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:10.262892 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:10.522758 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:15:10.523950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:15:10.524249 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Creating image(s)
May 13 02:15:10.524789 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:10.525003 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:10.525660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:10.526569 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:10.540585 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:10.541915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:10.577839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:10.645552 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:15:10.645552 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.679s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:10.648445 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:15:10.648445 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:10.651280 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638510.6500845, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:15:10.659622 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 for instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:15:10.659622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:10.660870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:10.664717 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdb from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the live domain config.
May 13 02:15:10.666026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:10.666532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:10.666704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:10.667936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:10.668516 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:10.671993 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:10.672468 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:10.741772 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:15:10.746400 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2264da72-05c5-4fda-a982-99cbacea19c2 req-9590b45e-8f7e-4430-b3be-3a8e43ed912f service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-deleted-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:10.746987 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-2264da72-05c5-4fda-a982-99cbacea19c2 req-9590b45e-8f7e-4430-b3be-3a8e43ed912f service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Neutron deleted interface ceee96c6-5ccb-4279-83dc-7205a74794e2; detaching it from the instance and deleting it from the info cache
May 13 02:15:10.747466 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2264da72-05c5-4fda-a982-99cbacea19c2 req-9590b45e-8f7e-4430-b3be-3a8e43ed912f service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:10.782382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638510.781919, 96973110-5b6f-4469-8513-47e1f791fa60 => ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:15:10.783736 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 for instance 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:15:10.784677 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:10.784758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:10.815766 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config.
May 13 02:15:10.817773 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:10.818399 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:10.818594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:10.833364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:10.850382 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk 1073741824" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:10.850927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:10.851626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:10.959671 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:10.960230 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:10.960676 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:15:10.961435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:11.045879 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:11.053406 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:11.070915 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:11.070915 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:11.073984 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:11.073984 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.087633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:11.089771 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Cannot resize image /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:15:11.090222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:15:11.090442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Ensure instance console log exists: /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:15:11.090793 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:11.091034 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:11.091247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:11.092406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.101014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.126161 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.126579 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.143298 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:11.202779 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:11.205989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260]
May 13 02:15:11.205989 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260] successful.
May 13 02:15:11.205989 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.223567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.235460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260]
May 13 02:15:11.235460 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260] successful.
May 13 02:15:11.235460 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.251887 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.252604 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:11.253447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:11.253644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:11.254769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:11.257278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2264da72-05c5-4fda-a982-99cbacea19c2 req-9590b45e-8f7e-4430-b3be-3a8e43ed912f service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Detach interface failed, port_id=ceee96c6-5ccb-4279-83dc-7205a74794e2, reason: Instance 5aedc303-4005-4670-a46c-81accc9a0101 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:15:11.263150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('9', '-', '-', 0) found on session 149 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:11.263150 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:11.280313 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:11.280949 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] Acquiring lock "5aedc303-4005-4670-a46c-81accc9a0101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:11.281204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:11.281366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] Lock "5aedc303-4005-4670-a46c-81accc9a0101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:11.281537 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] No waiting events found dispatching network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:11.281707 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2956ee06-eb0f-4666-918a-f64afb7eb080 req-4fe6674f-891e-44d9-b061-f4bc9de36942 service nova] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Received event network-vif-unplugged-ceee96c6-5ccb-4279-83dc-7205a74794e2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:11.282944 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.275s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:11.282944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:11.287896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 149 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:11.287896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:11.287896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('18', '-', '-', 0) found on session 150 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:11.287896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:11.308555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 150 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:11.308555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:11.462198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-632d58e1-cd1a-479d-8a36-454e6c1602e1 req-fa639f94-b130-4a64-b43b-14ed61eb54f6 service nova] Releasing lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:11.462953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquired lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:11.463260 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:15:11.713447 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Took 1.51 seconds to deallocate network for instance.
May 13 02:15:12.010600 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:15:12.030169 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:15:12.208233 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:12.220844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:12.221041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:12.390374 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating instance_info_cache with network_info: [{"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:12.689643 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:12.689905 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:12.901186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Releasing lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:12.901654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance network_info: |[{"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:15:12.903541 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Start _get_guest_xml network_info=[{"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:15:12.908894 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:15:12.910407 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1957344971', uuid='84dee6c9-e7c2-44ef-a37f-f4b8707326b7'), owner=OwnerMeta(userid='63c9dc09e45e4cdeb438d163532a8849', username='tempest-TestEncryptedCinderVolumes-1329189432-project-member', projectid='cf4cdaf6da19497586ec83765be014b7', projectname='tempest-TestEncryptedCinderVolumes-1329189432'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638512.909998) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:15:12.911757 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:15:12.912060 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:15:12.913173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:15:12.913363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:15:12.914415 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:15:12.914789 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:15:12.914973 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:15:12.915083 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:15:12.915246 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:15:12.915333 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:15:12.915457 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:15:12.915649 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:15:12.915756 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:15:12.915869 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:15:12.915967 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:15:12.916088 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:15:12.928580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1957344971',display_name='tempest-TestEncryptedCinderVolumes-server-1957344971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1957344971',id=61,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/UK17ZVIzXIpVq8QKgVhfRWXC1CeB2h17eXycHatPa0uzWATW8KREOdZomWDPgIrFROqPBZFpHP+7ZwNfS0TnmiYiUJi7Ovef+6sCuJr5VFgG18giur3ENGaL/iTZR/A==',key_name='tempest-keypair-985510521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-a8x81jnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=84dee6c9-e7c2-44ef-a37f-f4b8707326b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:15:12.928787 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:12.929348 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:12.929902 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'pci_devices' on Instance uuid 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:13.030939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 3300000008297f78b for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:15:13.031292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:13.031519 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3069ms) {'type': 'block', 'scsi_wwn': '3300000008297f78b', 'path': '/dev/dm-0', 'multipath_id': '3300000008297f78b'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:13.031673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008297f78b', 'path': '/dev/dm-0', 'multipath_id': '3300000008297f78b'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:15:13.032169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.365s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:13.032714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:13.033030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.066627 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.067031 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:13.067031 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:13.067411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '139')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:13.068928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8', '138')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:13.070621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c56c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'): ({'sdo'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:13.070890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Removing multipathed devices sdn, sdo {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:13.071237 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flush multipath device 330000000c22c508c {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:13.105287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:13.158172 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:13.192968 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:13.210675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:13.210933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:13.216799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:13.227060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:13.227303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:13.238901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.285261 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.40.100,3260]
May 13 02:15:13.285261 np0000000663 nova-compute[98103]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.40.100,3260] successful.
May 13 02:15:13.285261 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.314367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.329340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.363074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.50.100,3260]
May 13 02:15:13.363074 np0000000663 nova-compute[98103]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-c978476a-a85c-44cd-ada6-eb5a6b8abdb8, portal: 192.168.50.100,3260] successful.
May 13 02:15:13.363074 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.384055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.384272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:13.384388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== disconnect_volume: return (2717ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:13.384508 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:13.387168 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.568s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:13.387588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:13.387847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.419577 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:13.419999 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:13.419999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:13.420337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '144')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:13.421087 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0', '145')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:13.421965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6ab1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:13.422152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:13.422366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flush multipath device 330000000f54dfed4 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:13.436214 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <uuid>84dee6c9-e7c2-44ef-a37f-f4b8707326b7</uuid>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <name>instance-0000003d</name>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1957344971</nova:name>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:15:12</nova:creationTime>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:user uuid="63c9dc09e45e4cdeb438d163532a8849">tempest-TestEncryptedCinderVolumes-1329189432-project-member</nova:user>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:project uuid="cf4cdaf6da19497586ec83765be014b7">tempest-TestEncryptedCinderVolumes-1329189432</nova:project>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         <nova:port uuid="9323fc02-c359-4327-a3d9-14269b62beae">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <system>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="serial">84dee6c9-e7c2-44ef-a37f-f4b8707326b7</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="uuid">84dee6c9-e7c2-44ef-a37f-f4b8707326b7</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </system>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <os>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </os>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <features>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </features>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   <devices>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.config"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:24:09:6f"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <target dev="tap9323fc02-c3"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </interface>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/console.log" append="off"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </serial>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <video>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </video>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </rng>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:   </devices>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]: </domain>
May 13 02:15:13.436214 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Preparing to wait for external event network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1957344971',display_name='tempest-TestEncryptedCinderVolumes-server-1957344971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1957344971',id=61,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/UK17ZVIzXIpVq8QKgVhfRWXC1CeB2h17eXycHatPa0uzWATW8KREOdZomWDPgIrFROqPBZFpHP+7ZwNfS0TnmiYiUJi7Ovef+6sCuJr5VFgG18giur3ENGaL/iTZR/A==',key_name='tempest-keypair-985510521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-a8x81jnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=84dee6c9-e7c2-44ef-a37f-f4b8707326b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:15:13.439575 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.440371 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:13.440371 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:15:13.441838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.442001 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a12a33d-2832-554d-a901-4823f5fd42f2', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:13.442841 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.443604 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:13.443866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.445498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.445654 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9323fc02-c3, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:13.446035 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9323fc02-c3, col_values=(('qos', UUID('286feb2d-7030-4a15-8753-3e88c11ce592')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:13.446271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9323fc02-c3, col_values=(('external_ids', {'iface-id': '9323fc02-c359-4327-a3d9-14269b62beae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:09:6f', 'vm-uuid': '84dee6c9-e7c2-44ef-a37f-f4b8707326b7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:13.447031 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.448455 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:13.453502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:13.454288 np0000000663 nova-compute[98103]: INFO os_vif [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3')
May 13 02:15:13.462242 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:13.516962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:13.538042 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:15:13.538620 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:13.539164 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:13.539802 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:13.576486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:13.576647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:13.578038 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:13.588766 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:13.588914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:13.600377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.652264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.40.100,3260]
May 13 02:15:13.652264 np0000000663 nova-compute[98103]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.40.100,3260] successful.
May 13 02:15:13.652264 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.678423 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.690795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.701282 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.480s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:13.731011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.50.100,3260]
May 13 02:15:13.731011 np0000000663 nova-compute[98103]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-e6c51d2f-8f97-4246-bbc6-5da0dd02eae0, portal: 192.168.50.100,3260] successful.
May 13 02:15:13.731011 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.762839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:13.763027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:13.763197 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== disconnect_volume: return (2944ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:13.763501 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:13.780112 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Deleted allocations for instance 5aedc303-4005-4670-a46c-81accc9a0101
May 13 02:15:13.953056 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:14.047803 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] End _get_guest_xml xml=<domain type="qemu">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <uuid>40182305-b217-4ea3-bb1a-09b673321381</uuid>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <name>instance-0000003c</name>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-1493331219</nova:name>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:15:09</nova:creationTime>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         <nova:port uuid="059fb0c1-9865-4348-bf5f-8056dbe21fbf">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <system>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="serial">40182305-b217-4ea3-bb1a-09b673321381</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="uuid">40182305-b217-4ea3-bb1a-09b673321381</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </system>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <os>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </os>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <features>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </features>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   <devices>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <alias name="ua-426820d4-748c-4053-9d82-e2d0681ee491"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <serial>426820d4-748c-4053-9d82-e2d0681ee491</serial>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:8b:7c:fc"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <target dev="tap059fb0c1-98"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </interface>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/console.log" append="off"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </serial>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <video>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </video>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </rng>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:   </devices>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]: </domain>
May 13 02:15:14.047803 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Preparing to wait for external event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:14.051344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:15:14.052002 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.052216 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89eb48e4-b4e3-5b05-9fed-95219c7c5484', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:14.052942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.053583 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:14.067541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.070334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.070479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap059fb0c1-98, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:14.070749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap059fb0c1-98, col_values=(('qos', UUID('9390ca30-0ad9-45dd-9464-525c5e44bdc7')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:14.070963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap059fb0c1-98, col_values=(('external_ids', {'iface-id': '059fb0c1-9865-4348-bf5f-8056dbe21fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:7c:fc', 'vm-uuid': '40182305-b217-4ea3-bb1a-09b673321381'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:14.072075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.073229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:14.084912 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:14.086062 np0000000663 nova-compute[98103]: INFO os_vif [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98')
May 13 02:15:14.344985 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:14.789791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2502e0cf-4aea-40a8-af44-dda4b8d52055 tempest-TestServerVolumeAttachScenarioOldVersion-679853933 tempest-TestServerVolumeAttachScenarioOldVersion-679853933-project-member] Lock "5aedc303-4005-4670-a46c-81accc9a0101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.486s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:14.896987 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:14.960977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-004f65a7-a6f0-414c-92e1-59ffd6ee3df4 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.493s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:14.960977 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.063s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:14.973200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:14.973200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:14.973200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:24:09:6f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:14.973745 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Using config drive
May 13 02:15:15.354476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e696474d-1fb6-4faa-bc37-471bbdc61084 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.795s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:15.463873 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Detaching volume c868cceb-3a30-43ca-9caa-d155c4869fc7
May 13 02:15:15.483414 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:15.526652 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Attempting to driver detach volume c868cceb-3a30-43ca-9caa-d155c4869fc7 from mountpoint /dev/vdc
May 13 02:15:15.534532 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdc by alias ua-c868cceb-3a30-43ca-9caa-d155c4869fc7 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:15.536229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Found disk vdc by alias ua-c868cceb-3a30-43ca-9caa-d155c4869fc7 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:15.536366 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Attempting to detach device vdc from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:15:15.537062 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <alias name="ua-c868cceb-3a30-43ca-9caa-d155c4869fc7"/>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <serial>c868cceb-3a30-43ca-9caa-d155c4869fc7</serial>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:15.537062 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:15.543371 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdc from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the persistent domain config.
May 13 02:15:15.543524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] (1/8): Attempting to detach device vdc with device alias ua-c868cceb-3a30-43ca-9caa-d155c4869fc7 from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:15:15.544654 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <alias name="ua-c868cceb-3a30-43ca-9caa-d155c4869fc7"/>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-11"/>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <serial>c868cceb-3a30-43ca-9caa-d155c4869fc7</serial>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:15.544654 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:15.614085 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:15.614239 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:15.614284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:8b:7c:fc, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:15.614718 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Using config drive
May 13 02:15:15.622888 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Creating config drive at /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.config
May 13 02:15:15.630757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5dpr3_2q {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:15.699369 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5dpr3_2q" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:15.836977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.128849 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:16.184305 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638516.1829517, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => ua-c868cceb-3a30-43ca-9caa-d155c4869fc7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:15:16.189727 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-c868cceb-3a30-43ca-9caa-d155c4869fc7 for instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:15:16.197606 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully detached device vdc from instance 6f68c3ac-8dfc-4202-9786-2ba013b12833 from the live domain config.
May 13 02:15:16.202745 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:16.203164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:16.203306 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:16.203900 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:16.204987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c868cceb-3a30-43ca-9caa-d155c4869fc7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:16.205217 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:16.240814 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:16.241301 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:16.241301 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '148'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:16.241716 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '147')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:16.242599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7', '146')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:16.244216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7c7880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'): ({'sdl'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:16.244545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Removing multipathed devices sdl, sdp {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:16.244902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Flush multipath device 330000000af83b38e {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:16.273333 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Creating config drive at /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config
May 13 02:15:16.277970 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nkistqt {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:16.302883 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:16.316851 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.352544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:16.361931 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.373518 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9nkistqt" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:16.403251 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if SCSI volumes sdl, sdp have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:16.403435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] SCSI volumes sdl, sdp have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:16.405078 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Checking to see if device paths {'sdl', 'sdp'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:16.417608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Device paths {'sdl', 'sdp'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:16.417842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:16.429156 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.456186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.470392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.40.100,3260]
May 13 02:15:16.470392 np0000000663 nova-compute[98103]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.40.100,3260] successful.
May 13 02:15:16.470392 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.492523 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.506742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.542178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.50.100,3260]
May 13 02:15:16.542178 np0000000663 nova-compute[98103]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-c868cceb-3a30-43ca-9caa-d155c4869fc7, portal: 192.168.50.100,3260] successful.
May 13 02:15:16.542178 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.562855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:16.562991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:16.563140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] <== disconnect_volume: return (359ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:16.563307 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:16.712205 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a407806-f436-438d-be4d-c8264f20df57 req-92d72a26-dca2-40f8-8f25-4c8bb780f4ec service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:16.712482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a407806-f436-438d-be4d-c8264f20df57 req-92d72a26-dca2-40f8-8f25-4c8bb780f4ec service nova] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:16.712853 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a407806-f436-438d-be4d-c8264f20df57 req-92d72a26-dca2-40f8-8f25-4c8bb780f4ec service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:16.713537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a407806-f436-438d-be4d-c8264f20df57 req-92d72a26-dca2-40f8-8f25-4c8bb780f4ec service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:16.713943 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.715657 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a407806-f436-438d-be4d-c8264f20df57 req-92d72a26-dca2-40f8-8f25-4c8bb780f4ec service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Processing event network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:15:16.719271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.727939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.756951 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.765936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:16.974873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.014037 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.120821 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.159898 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'flavor' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:17.379769 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.410790 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:17.410966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:17.435189 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.440406 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.469763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.471005 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:17.483753 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7720df7b-d552-4495-8608-5e323c9029ec req-d672a8f8-813c-43e3-9906-e07d2496c7a5 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:17.484023 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7720df7b-d552-4495-8608-5e323c9029ec req-d672a8f8-813c-43e3-9906-e07d2496c7a5 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:17.484590 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7720df7b-d552-4495-8608-5e323c9029ec req-d672a8f8-813c-43e3-9906-e07d2496c7a5 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:17.484930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7720df7b-d552-4495-8608-5e323c9029ec req-d672a8f8-813c-43e3-9906-e07d2496c7a5 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:17.485610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7720df7b-d552-4495-8608-5e323c9029ec req-d672a8f8-813c-43e3-9906-e07d2496c7a5 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Processing event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:15:17.924850 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:17.962929 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638517.962478, 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:17.963522 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:15:17.964867 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] VM Started (Lifecycle Event)
May 13 02:15:17.968526 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:15:17.975452 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance spawned successfully.
May 13 02:15:17.976059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:15:18.056640 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:15:18.059321 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:15:18.062144 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance spawned successfully.
May 13 02:15:18.062515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:15:18.167317 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:18.174376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a2947b60-bc5e-4f98-9496-66e7075b9b4a tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.213s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:18.468282 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:18.472583 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:18.488566 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.488913 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.489600 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.490012 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.490460 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.491255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.570262 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.570670 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.571186 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.571684 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.571995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.572339 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:18.822346 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:18.822593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:18.822773 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:18.822918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:18.823037 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] No waiting events found dispatching network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:18.823201 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f262dee3-0385-46cb-b3d7-104b09f69fca req-fa848679-780a-4363-9b5e-6906f1ca7112 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received unexpected event network-vif-plugged-9323fc02-c359-4327-a3d9-14269b62beae for instance with vm_state building and task_state spawning.
May 13 02:15:18.935824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.525s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:18.977163 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:15:18.978225 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638518.977278, 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:18.978225 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] VM Paused (Lifecycle Event)
May 13 02:15:19.000397 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Took 8.48 seconds to spawn the instance on the hypervisor.
May 13 02:15:19.000397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:19.074890 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:19.080109 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Took 9.91 seconds to spawn the instance on the hypervisor.
May 13 02:15:19.080468 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:19.483484 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:19.489959 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638519.4894884, 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:19.490146 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] VM Resumed (Lifecycle Event)
May 13 02:15:19.523732 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Took 15.33 seconds to build instance.
May 13 02:15:19.579191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:19.579191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:19.579191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:19.579332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:19.579438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:19.584192 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Terminating instance
May 13 02:15:19.610510 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Took 17.33 seconds to build instance.
May 13 02:15:19.628739 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:19.628739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:19.628964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:19.629058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:19.629180 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:19.629320 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-74cf5f60-b5f5-48fc-8f59-10e650f62850 req-1a858539-7e4e-4905-ae17-38b76e36f535 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received unexpected event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with vm_state active and task_state None.
May 13 02:15:19.994457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:19.999619 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:20.029948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0675ba28-3c27-4100-a29f-8560ff2d6cca tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.838s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:20.035724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:20.035724 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:20.035724 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attaching volume 654126c4-fffa-4082-b132-08f07d7e8081 to /dev/vdb
May 13 02:15:20.088781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:15:20.109989 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:20.114030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-51e9b7ff-a9fa-4e3d-b27a-2f3d1614281e tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.840s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:20.116774 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.124406 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.124833 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.135283 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:15:20.149529 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.155725 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.171113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:20.191489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.224964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:15:20.226155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:15:20.238115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:15:20.238776 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fe8b:7cfc', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe58:afb7', 'fe80::c451:c4ff:fe13:30b3', 'fe80::fc16:3eff:fec1:5386', 'fe80::fc16:3eff:fe83:ac7f', 'fe80::fc16:3eff:fe24:96f'] 
May 13 02:15:20.238878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:15:20.238994 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:15:20.239352 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:20.239636 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating existing volume attachment record: 5e44f617-fa4d-42ab-965c-af5614dd0dd0 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:15:20.413299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.456553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.459636 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Instance destroyed successfully.
May 13 02:15:20.459636 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lazy-loading 'resources' on Instance uuid 6f68c3ac-8dfc-4202-9786-2ba013b12833 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:20.502556 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638520.5021243, 40182305-b217-4ea3-bb1a-09b673321381 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:20.503037 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Started (Lifecycle Event)
May 13 02:15:20.812248 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:15:20.812764 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:20.812995 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:20.813608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:20.813915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:15:20.832008 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:20.832690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:20.833394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:20.835599 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:20.835599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:20.835599 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:20.844980 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.851154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:20.851154 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081] added
May 13 02:15:20.868493 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:20.868493 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:20.868493 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:20.868894 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:20.868894 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:20.873054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.874419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:15:20.874419 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:20.880930 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.884974 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.894748 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081] added
May 13 02:15:20.894748 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:15:20.894748 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:20.894748 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:20.894748 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:15:20.894748 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:15:20.894748 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:20.895055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:15:20.895186 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0606(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:15:20.895359 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:15:20.915191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.923231 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.967311 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1695220652',display_name='tempest-AttachVolumeTestJSON-server-1695220652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-attachvolumetestjson-server-1695220652',id=57,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXPJjWGYN0mCVh3usS2AX3xyR959EesySMcY4K9fLeaJvpiIEKxVj22oSKAb6jTCPd5/sByGBIStfIJjCybX9GU1JmznuPyO7NVOwe0EYAWMbHx1onZSaxzpGlB9FPOA==',key_name='tempest-keypair-1757250784',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:14:00Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c97b10a192fd43f689e55b4537a4f824',ramdisk_id='',reservation_id='r-6bhjh0fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1185409082',owner_user_name='tempest-AttachVolumeTestJSON-1185409082-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b3cc512843b427fa59414fdf92f5e76',uuid=6f68c3ac-8dfc-4202-9786-2ba013b12833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:15:20.967311 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converting VIF {"id": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "address": "fa:16:3e:c0:4d:60", "network": {"id": "892c7e93-24c2-4286-824a-842011a5cb3f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-802407322-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c97b10a192fd43f689e55b4537a4f824", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47d27c6-c2", "ovs_interfaceid": "f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:20.967311 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:20.969826 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:15:20.973661 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.974645 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf47d27c6-c2, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:20.980143 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:20.980143 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.980143 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70078dbe-c2c8-4fd0-8d3e-b0f87c438212) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:20.981176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:20.983605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:20.988131 np0000000663 nova-compute[98103]: INFO os_vif [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:4d:60,bridge_name='br-int',has_traffic_filtering=True,id=f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3,network=Network(892c7e93-24c2-4286-824a-842011a5cb3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47d27c6-c2')
May 13 02:15:20.989073 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Deleting instance files /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833_del
May 13 02:15:20.990924 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Deletion of /opt/stack/data/nova/instances/6f68c3ac-8dfc-4202-9786-2ba013b12833_del complete
May 13 02:15:21.012589 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:21.016275 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:21.063290 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:21.096162 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:21.145683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:21.301146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:21.504555 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Took 1.42 seconds to destroy the instance on the hypervisor.
May 13 02:15:21.508227 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:15:21.510525 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:15:21.510525 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:15:21.510905 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:21.520814 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638521.5203562, 40182305-b217-4ea3-bb1a-09b673321381 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:21.523568 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Paused (Lifecycle Event)
May 13 02:15:21.869638 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:21.889759 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:21.889759 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:21.896054 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:15:21.908989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:15:21.925543 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:15:21.925543 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:21.938791 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:21.941174 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:21.949604 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:21.961495 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:21.986989 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.40.100,3260]
May 13 02:15:21.986989 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.40.100,3260] successful.
May 13 02:15:21.986989 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:22.014904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.016377 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.017191 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:22.025043 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:22.033522 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638522.0325484, 40182305-b217-4ea3-bb1a-09b673321381 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:22.033522 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Resumed (Lifecycle Event)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.042684 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:22.042684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:22.046327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('15', '-', '-', 0) found on session 151 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:22.046327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:22.092365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 151 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:22.092365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:22.092365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.50.100,3260]
May 13 02:15:22.092365 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.50.100,3260] successful.
May 13 02:15:22.092365 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:22.107576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.131829 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:22.132269 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:22.132578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.298s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:22.132578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:15:22.133905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] HCTL ('16', '-', '-', 0) found on session 152 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:15:22.133976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:15:22.164142 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Searching for a device in session 152 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:15:22.164142 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:15:22.272754 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-changed-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:22.272754 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Refreshing instance network info cache due to event network-changed-059fb0c1-9865-4348-bf5f-8056dbe21fbf. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:22.272754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] Acquiring lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:22.272754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] Acquired lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:22.272754 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Refreshing network info cache for port 059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:22.360226 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-changed-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:22.362832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Refreshing instance network info cache due to event network-changed-9323fc02-c359-4327-a3d9-14269b62beae. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:22.363236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] Acquiring lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:22.363236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] Acquired lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:22.363236 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Refreshing network info cache for port 9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:22.537648 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:22.540895 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:22.774648 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:22.837356 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:15:22.866809 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:23.046571 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999231773000247 future=<Future at 0x705c881c6b70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:23.255155 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:23.322244 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:23.349232 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:23.445445 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updated VIF entry in instance network info cache for port 059fb0c1-9865-4348-bf5f-8056dbe21fbf. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:15:23.447702 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:23.594736 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updated VIF entry in instance network info cache for port 9323fc02-c359-4327-a3d9-14269b62beae. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:15:23.595263 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating instance_info_cache with network_info: [{"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:23.830806 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Took 2.32 seconds to deallocate network for instance.
May 13 02:15:23.866167 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found WWN 3300000000762bfc5 for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:15:23.866619 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.053s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:23.867007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== connect_volume: return (3054ms) {'type': 'block', 'scsi_wwn': '3300000000762bfc5', 'path': '/dev/dm-10', 'multipath_id': '3300000000762bfc5'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:23.867007 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000762bfc5', 'path': '/dev/dm-10', 'multipath_id': '3300000000762bfc5'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:15:23.879177 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:23.949910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d28242b-b6fd-4542-af30-7abf3ea31d88 req-5125183a-a518-4ba5-9107-404e9da5cf31 service nova] Releasing lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:24.097162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fa4a13ba-d4a3-4739-9efd-60770e503810 req-0ea0cee7-f2e5-4957-a421-25ba15cc0687 service nova] Releasing lock "refresh_cache-84dee6c9-e7c2-44ef-a37f-f4b8707326b7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:24.177574 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005129539999870758 future=<Future at 0x705c486f0410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:24.177700 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:24.178033 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.867927471000257 future=<Future at 0x705c881c6b70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:24.178033 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.867798231000052 future=<Future at 0x705c881c6b70 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:24.179114 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Emitting event <LifecycleEvent: 1778638509.1769426, 5aedc303-4005-4670-a46c-81accc9a0101 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:24.179417 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] VM Stopped (Lifecycle Event)
May 13 02:15:24.328226 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:24.341331 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:24.341513 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:24.381029 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to attach volume 654126c4-fffa-4082-b132-08f07d7e8081 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:15:24.386114 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:   <alias name="ua-654126c4-fffa-4082-b132-08f07d7e8081"/>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:   <serial>654126c4-fffa-4082-b132-08f07d7e8081</serial>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:24.386114 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:15:24.463926 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-696cfbae-3ecc-47fb-a243-f1b4c6053ea3 req-91d9ca93-6721-4f48-842b-15d7f53c3d3a service nova] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Received event network-vif-deleted-f47d27c6-c27d-4baa-b4d3-42a9b8e04ff3 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:24.683439 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0bb4850f-44e2-47f9-9e1e-2879dea4294e tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5aedc303-4005-4670-a46c-81accc9a0101] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:24.820442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:24.820765 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:25.323489 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:25.607698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:25.830857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.489s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:25.841233 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:25.907265 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Deleted allocations for instance 6f68c3ac-8dfc-4202-9786-2ba013b12833
May 13 02:15:25.982607 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:26.079170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:26.079292 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:26.079397 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:26.079533 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] No VIF found with MAC fa:16:3e:58:af:b7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:26.232278 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:26.918375 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-653148d4-c120-461c-9057-b8d6a7f2e515 tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Lock "6f68c3ac-8dfc-4202-9786-2ba013b12833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.339s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:27.661471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fff6cc4a-f643-47dc-a1d5-e91fd0e27a44 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.626s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:27.678905 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:28.015720 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:29.544314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:30.843493 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:30.984338 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:31.982697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:31.983214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:32.488047 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Detaching volume 654126c4-fffa-4082-b132-08f07d7e8081
May 13 02:15:32.565831 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Attempting to driver detach volume 654126c4-fffa-4082-b132-08f07d7e8081 from mountpoint /dev/vdb
May 13 02:15:32.573568 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-654126c4-fffa-4082-b132-08f07d7e8081 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:32.575678 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Found disk vdb by alias ua-654126c4-fffa-4082-b132-08f07d7e8081 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:15:32.575849 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Attempting to detach device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:15:32.576209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <alias name="ua-654126c4-fffa-4082-b132-08f07d7e8081"/>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <serial>654126c4-fffa-4082-b132-08f07d7e8081</serial>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:32.576209 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:32.588209 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the persistent domain config.
May 13 02:15:32.588363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] (1/8): Attempting to detach device vdb with device alias ua-654126c4-fffa-4082-b132-08f07d7e8081 from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:15:32.588601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <alias name="ua-654126c4-fffa-4082-b132-08f07d7e8081"/>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-10"/>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <serial>654126c4-fffa-4082-b132-08f07d7e8081</serial>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]: </disk>
May 13 02:15:32.588601 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:15:33.135563 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:33.371297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638533.3707457, 96973110-5b6f-4469-8513-47e1f791fa60 => ua-654126c4-fffa-4082-b132-08f07d7e8081> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:15:33.374227 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-654126c4-fffa-4082-b132-08f07d7e8081 for instance 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:15:33.377493 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully detached device vdb from instance 96973110-5b6f-4469-8513-47e1f791fa60 from the live domain config.
May 13 02:15:33.380083 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:33.380585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:33.380762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:33.381425 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:33.381849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '654126c4-fffa-4082-b132-08f07d7e8081', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:33.382271 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6 (non-flash)
May 13 02:15:33.424876 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6 (non-flash)
May 13 02:15:33.425370 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', '152'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6', '154')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:33.425370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', '151')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:33.426619 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081', '152')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:33.427563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c42c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:33.427780 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Removing multipathed devices sdk, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:33.428056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Flush multipath device 3300000000762bfc5 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:33.480352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:33.550181 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:33.561840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:33.619528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:33.619528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:33.621028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:33.643021 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:33.643164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:33.659639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.701310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 151, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.40.100,3260]
May 13 02:15:33.701310 np0000000663 nova-compute[98103]: Logout of [sid: 151, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.40.100,3260] successful.
May 13 02:15:33.701310 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.730357 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.746580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.788755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.50.100,3260]
May 13 02:15:33.788755 np0000000663 nova-compute[98103]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-654126c4-fffa-4082-b132-08f07d7e8081, portal: 192.168.50.100,3260] successful.
May 13 02:15:33.788755 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.817976 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:33.818228 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:33.818638 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] <== disconnect_volume: return (437ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:33.818638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:34.417340 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'flavor' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:35.430709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0f82ef0a-2e22-4d18-9ef7-9b0e08e72b05 tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.448s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:35.845955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:35.985254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:36.164084 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:38.047588 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0017800119999265007 future=<Future at 0x705c881c6b70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:38.048290 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Emitting event <LifecycleEvent: 1778638523.0456896, 6f68c3ac-8dfc-4202-9786-2ba013b12833 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:38.048651 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:38.048802 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] VM Stopped (Lifecycle Event)
May 13 02:15:38.551654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 6f68c3ac-8dfc-4202-9786-2ba013b12833] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:39.595858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:39.596490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:40.100126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:15:40.671450 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:40.672029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:40.677110 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:15:40.677110 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Claim successful on node np0000000663
May 13 02:15:40.856414 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:40.987878 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:42.183859 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:42.184881 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:42.687552 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:43.195791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.524s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:43.195791 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:15:43.701642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:15:43.701946 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:15:43.702238 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:43.702471 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:43.772345 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86981c5164f4476893f3937fe22f5a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5475f08f0a44c4a95ec0ce67c5f366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:15:43.839535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:43.839738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:43.839968 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:43.840153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:43.840317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:43.842806 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Terminating instance
May 13 02:15:44.207248 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:15:44.347634 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:15:44.366111 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Successfully created port: a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:15:44.368208 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:44.370397 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:44.396201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:44.501191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:44.501457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:44.501700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:44.501913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:44.502083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:44.506966 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Terminating instance
May 13 02:15:44.557656 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:44.564050 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:44.623564 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:44.624027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:44.624248 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:44.624374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:44.624533 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] No waiting events found dispatching network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:44.624597 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-babf1072-992d-4aa6-a75b-d2477c664834 req-829fd380-d154-4c1f-8104-10509748f4b3 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:44.719633 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999698891000207 future=<Future at 0x705c801eb680 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:44.720323 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99900505100004 future=<Future at 0x705c801eb680 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:44.720446 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998851917000138 future=<Future at 0x705c801eb680 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:44.720552 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Instance destroyed successfully.
May 13 02:15:44.722975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:15:44.724044 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'resources' on Instance uuid b98bc978-d744-41a3-b579-17dc08777b8d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:45.011881 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:15:45.046763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.050785 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.075017 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.101137 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.139578 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.140949 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.229855 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-2036478889',display_name='tempest-TestVolumeBootPatternV346-server-2036478889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-2036478889',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNekVnf5kkjAKMOZTtTZq9wn037/DSkP0RdP6LgND/IHVKZcKNdaA/0adWpN+UdMaGxDCAMRJtPJeX9271ojMh8TeTtZZ8b3zeBlGVrg2elrblMP2vIL8VXmqtedkySw==',key_name='tempest-keypair-1210820551',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:04Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-dhpcj88v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=b98bc978-d744-41a3-b579-17dc08777b8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:15:45.230695 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "address": "fa:16:3e:83:ac:7f", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ba8fa8-d1", "ovs_interfaceid": "65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:45.230822 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:45.231057 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:15:45.236262 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.236559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65ba8fa8-d1, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:45.241116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:45.250645 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.252271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.252543 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23342872-8269-4a38-a833-0ba4e9428de2) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:45.253689 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.254451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:45.267358 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.271696 np0000000663 nova-compute[98103]: INFO os_vif [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:ac:7f,bridge_name='br-int',has_traffic_filtering=True,id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ba8fa8-d1')
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f68e0c10-e63b-4db1-a0a9-bb391d150f76', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:45.279041 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6 (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c (non-flash)
May 13 02:15:45.327153 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-86574f7c-cef5-4eaf-8d28-0ea699f2fff6', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2047348f-7d84-4762-b739-740f2b286a3c', '155')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '142')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:45.327153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76', '143')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:45.328485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c240360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:45.328824 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:45.329282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flush multipath device 3300000003c64c638 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:45.355660 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999655359999906 future=<Future at 0x705c487396a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:45.358984 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Instance destroyed successfully.
May 13 02:15:45.359950 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lazy-loading 'resources' on Instance uuid 96973110-5b6f-4469-8513-47e1f791fa60 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:45.376943 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Successfully updated port: a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:15:45.391978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:45.458359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:45.508585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:45.508585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:45.509335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:45.526380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:45.527537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:45.541827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.589918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.40.100,3260]
May 13 02:15:45.589918 np0000000663 nova-compute[98103]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.40.100,3260] successful.
May 13 02:15:45.589918 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.614481 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.634164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.674541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.50.100,3260]
May 13 02:15:45.674541 np0000000663 nova-compute[98103]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-f68e0c10-e63b-4db1-a0a9-bb391d150f76, portal: 192.168.50.100,3260] successful.
May 13 02:15:45.674541 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== disconnect_volume: return (426ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Deleting instance files /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d_del
May 13 02:15:45.705292 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Deletion of /opt/stack/data/nova/instances/b98bc978-d744-41a3-b579-17dc08777b8d_del complete
May 13 02:15:45.732785 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:15:45.734011 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:15:45.734330 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Creating image(s)
May 13 02:15:45.734729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:45.734889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:45.735446 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:45.736024 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:45.739909 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:45.741180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:45.846038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:45.846516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:45.847171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:45.847773 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:45.851805 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:15:45.852309 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:45.873735 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-648343419',display_name='tempest-SnapshotDataIntegrityTests-server-648343419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-snapshotdataintegritytests-server-648343419',id=53,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX0dJweJtTHRVvDEfD3Ct4rtQUbnVYLpccTZMY7IUZV2/r3hH4WcEJ1Uq3rmR1Qly7ig4H0rpK/erSpwNf5HJ1ISFkXcxZGqCcyTMk/Ga4qg2LZuKrKMb+jmLyqjV71tg==',key_name='tempest-keypair-906370292',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:13:26Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='870689e5ef3f426395f7245076bf7085',ramdisk_id='',reservation_id='r-k02amlg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2139004155',owner_user_name='tempest-SnapshotDataIntegrityTests-2139004155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:13:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ede91bfd8a22438dbe0124215f059630',uuid=96973110-5b6f-4469-8513-47e1f791fa60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:15:45.874397 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.878250 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converting VIF {"id": "3eb00744-546e-4637-b559-990890f2b11f", "address": "fa:16:3e:58:af:b7", "network": {"id": "26c1643b-5baa-4f59-ae11-9d17822a6593", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-613486841-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "870689e5ef3f426395f7245076bf7085", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb00744-54", "ovs_interfaceid": "3eb00744-546e-4637-b559-990890f2b11f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:45.880217 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:45.880774 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:15:45.883995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:45.887663 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquired lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:45.887974 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:15:45.891567 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.891757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb00744-54, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:45.896380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:45.897653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.897653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=145803d4-af74-41fa-ba7b-40d750333281) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:45.899229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:45.899635 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:45.902657 np0000000663 nova-compute[98103]: INFO os_vif [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:af:b7,bridge_name='br-int',has_traffic_filtering=True,id=3eb00744-546e-4637-b559-990890f2b11f,network=Network(26c1643b-5baa-4f59-ae11-9d17822a6593),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3eb00744-54')
May 13 02:15:45.904022 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Deleting instance files /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60_del
May 13 02:15:45.905592 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Deletion of /opt/stack/data/nova/instances/96973110-5b6f-4469-8513-47e1f791fa60_del complete
May 13 02:15:45.956585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.104s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:45.956954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:46.028201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk 1073741824" returned: 0 in 0.071s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:46.028546 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:46.028834 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:46.122355 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:46.123688 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:15:46.124030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:46.218462 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Took 1.87 seconds to destroy the instance on the hypervisor.
May 13 02:15:46.219781 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:15:46.220161 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:15:46.220286 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:15:46.220727 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:46.250025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:46.250655 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Cannot resize image /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:15:46.250761 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:15:46.250911 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Ensure instance console log exists: /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:15:46.251279 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:46.251525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:46.251672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:46.305218 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:46.415842 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 02:15:46.416395 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:15:46.416737 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:15:46.416900 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:15:46.417187 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:46.498312 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:15:46.506338 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:46.734673 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Acquiring lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "b98bc978-d744-41a3-b579-17dc08777b8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] No waiting events found dispatching network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-unplugged-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:46.755604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:46.755990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:46.755990 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:46.755990 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] No waiting events found dispatching network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:46.757269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:46.757269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:46.757269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing instance network info cache due to event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:46.757269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Acquiring lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:46.942210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-241fac65-eba5-4da7-895d-67a5406feaa1 req-5a0583d9-4349-4b84-8e7e-276b0cabb95b service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Received event network-vif-deleted-65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:46.942752 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-241fac65-eba5-4da7-895d-67a5406feaa1 req-5a0583d9-4349-4b84-8e7e-276b0cabb95b service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Neutron deleted interface 65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9; detaching it from the instance and deleting it from the info cache
May 13 02:15:46.942994 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-241fac65-eba5-4da7-895d-67a5406feaa1 req-5a0583d9-4349-4b84-8e7e-276b0cabb95b service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:46.970210 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating instance_info_cache with network_info: [{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:47.379139 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:47.447787 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-241fac65-eba5-4da7-895d-67a5406feaa1 req-5a0583d9-4349-4b84-8e7e-276b0cabb95b service nova] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Detach interface failed, port_id=65ba8fa8-d1d0-46f3-a9bd-1ef5c3ef68d9, reason: Instance b98bc978-d744-41a3-b579-17dc08777b8d could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:15:47.474082 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Releasing lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:47.474659 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Instance network_info: |[{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:15:47.476877 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Start _get_guest_xml network_info=[{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:15:47.481704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Acquired lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:47.481943 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:47.493893 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:15:47.495430 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1316139097', uuid='3fe8732c-63d4-4c50-950b-791d81d36975'), owner=OwnerMeta(userid='86981c5164f4476893f3937fe22f5a40', username='tempest-TestStampPattern-185105098-project-member', projectid='9b5475f08f0a44c4a95ec0ce67c5f366', projectname='tempest-TestStampPattern-185105098'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638547.4948967) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:15:47.500819 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:15:47.501178 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:15:47.505129 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:15:47.505434 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:15:47.507283 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:15:47.518861 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316139097',display_name='tempest-TestStampPattern-server-1316139097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1316139097',id=62,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-ygi8xtmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:45Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=3fe8732c-63d4-4c50-950b-791d81d36975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:15:47.519057 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:47.519814 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:47.520395 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:47.792278 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9259bcca-bb8f-418a-a897-d714369ca47c req-1a218bd0-287d-42e5-af5b-9263fe7a2127 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-deleted-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:47.792431 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-9259bcca-bb8f-418a-a897-d714369ca47c req-1a218bd0-287d-42e5-af5b-9263fe7a2127 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Neutron deleted interface 3eb00744-546e-4637-b559-990890f2b11f; detaching it from the instance and deleting it from the info cache
May 13 02:15:47.792636 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-9259bcca-bb8f-418a-a897-d714369ca47c req-1a218bd0-287d-42e5-af5b-9263fe7a2127 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:47.880499 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Took 1.66 seconds to deallocate network for instance.
May 13 02:15:47.984936 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:48.023244 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] End _get_guest_xml xml=<domain type="qemu">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <uuid>3fe8732c-63d4-4c50-950b-791d81d36975</uuid>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <name>instance-0000003e</name>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestStampPattern-server-1316139097</nova:name>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:15:47</nova:creationTime>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:user uuid="86981c5164f4476893f3937fe22f5a40">tempest-TestStampPattern-185105098-project-member</nova:user>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:project uuid="9b5475f08f0a44c4a95ec0ce67c5f366">tempest-TestStampPattern-185105098</nova:project>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         <nova:port uuid="a92a4af2-d56d-47be-b6b3-3fcc570ddc3a">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <system>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="serial">3fe8732c-63d4-4c50-950b-791d81d36975</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="uuid">3fe8732c-63d4-4c50-950b-791d81d36975</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </system>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <os>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </os>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <features>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </features>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   <devices>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.config"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </disk>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:5e:bb:d0"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <target dev="tapa92a4af2-d5"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </interface>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/console.log" append="off"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </serial>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <video>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </video>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </rng>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:   </devices>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]: </domain>
May 13 02:15:48.023244 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Preparing to wait for external event network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316139097',display_name='tempest-TestStampPattern-server-1316139097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1316139097',id=62,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-ygi8xtmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:15:45Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=3fe8732c-63d4-4c50-950b-791d81d36975,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:15:48.025422 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:48.025694 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:48.025739 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:15:48.026369 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:48.026998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:48.027515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:15:48.028611 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:48.028842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24c91871-0e03-56c2-aec4-625321a2d7f0', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:48.030062 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:48.031504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:48.033566 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:48.033895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa92a4af2-d5, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:48.034441 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa92a4af2-d5, col_values=(('qos', UUID('3dc523ce-a4f5-4a29-be50-fd0c836c9c9a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:48.034697 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa92a4af2-d5, col_values=(('external_ids', {'iface-id': 'a92a4af2-d56d-47be-b6b3-3fcc570ddc3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:bb:d0', 'vm-uuid': '3fe8732c-63d4-4c50-950b-791d81d36975'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:48.037782 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:48.043166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:48.045001 np0000000663 nova-compute[98103]: INFO os_vif [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5')
May 13 02:15:48.222860 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:48.298727 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9259bcca-bb8f-418a-a897-d714369ca47c req-1a218bd0-287d-42e5-af5b-9263fe7a2127 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Detach interface failed, port_id=3eb00744-546e-4637-b559-990890f2b11f, reason: Instance 96973110-5b6f-4469-8513-47e1f791fa60 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:15:48.308116 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:48.444921 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:15:48.448654 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updated VIF entry in instance network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:15:48.449070 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating instance_info_cache with network_info: [{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:48.725113 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Took 2.31 seconds to deallocate network for instance.
May 13 02:15:48.954189 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:48.954400 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:48.955107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Releasing lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:48.955439 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:48.955682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Acquiring lock "96973110-5b6f-4469-8513-47e1f791fa60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:48.955900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:48.956146 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] Lock "96973110-5b6f-4469-8513-47e1f791fa60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:48.956299 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] No waiting events found dispatching network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:48.956456 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-572ec075-6d1e-453f-b555-7d40d01eafa5 req-60bb9125-6452-448b-9377-a644618e54f1 service nova] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Received event network-vif-unplugged-3eb00744-546e-4637-b559-990890f2b11f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:49.233002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:49.300404 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:49.300777 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:49.563170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:49.563638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:15:49.563638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No VIF found with MAC fa:16:3e:5e:bb:d0, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:15:49.563959 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Using config drive
May 13 02:15:49.803801 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:50.069078 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:50.220544 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Creating config drive at /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.config
May 13 02:15:50.224258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgo6f4dah {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:15:50.296119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgo6f4dah" returned: 0 in 0.071s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:15:50.314728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.360s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:50.320727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.085s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:50.388926 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Deleted allocations for instance b98bc978-d744-41a3-b579-17dc08777b8d
May 13 02:15:50.668453 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:15:50.668936 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:15:50.731379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:50.767218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:50.768726 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:50.851277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:50.859930 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:50.986072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab0b1f03-a3fd-43a7-a126-f01de23cf342 req-a714b7ed-d4af-43d0-9696-d3e33a8d4deb service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:50.986842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab0b1f03-a3fd-43a7-a126-f01de23cf342 req-a714b7ed-d4af-43d0-9696-d3e33a8d4deb service nova] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:50.987038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab0b1f03-a3fd-43a7-a126-f01de23cf342 req-a714b7ed-d4af-43d0-9696-d3e33a8d4deb service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:50.987428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ab0b1f03-a3fd-43a7-a126-f01de23cf342 req-a714b7ed-d4af-43d0-9696-d3e33a8d4deb service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:50.987562 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ab0b1f03-a3fd-43a7-a126-f01de23cf342 req-a714b7ed-d4af-43d0-9696-d3e33a8d4deb service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Processing event network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:15:51.121759 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:51.124226 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:51.128559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:51.154722 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:51.157600 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:51.171592 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:15:51.400976 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4cf877be-4758-4d9d-ba6d-58b45fab2b52 tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "b98bc978-d744-41a3-b579-17dc08777b8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.561s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:51.678857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.361s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:51.689844 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:15:51.690561 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638551.690291, 3fe8732c-63d4-4c50-950b-791d81d36975 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:51.690725 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] VM Started (Lifecycle Event)
May 13 02:15:51.697050 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:15:51.701047 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Instance spawned successfully.
May 13 02:15:51.701468 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:15:51.751206 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Deleted allocations for instance 96973110-5b6f-4469-8513-47e1f791fa60
May 13 02:15:52.199210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:52.201619 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:52.210519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.210519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.210519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.210519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.213006 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.213006 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:15:52.704197 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:15:52.704583 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638552.7042615, 3fe8732c-63d4-4c50-950b-791d81d36975 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:52.704583 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] VM Paused (Lifecycle Event)
May 13 02:15:52.717150 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Took 6.98 seconds to spawn the instance on the hypervisor.
May 13 02:15:52.717863 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:52.760995 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e421af2e-30c5-4f32-8255-faab6111035f tempest-SnapshotDataIntegrityTests-2139004155 tempest-SnapshotDataIntegrityTests-2139004155-project-member] Lock "96973110-5b6f-4469-8513-47e1f791fa60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.259s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:53.036700 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:53.070592 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:53.071494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:53.071494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:53.071494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:53.071494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] No waiting events found dispatching network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:53.071494 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-3102d9ad-1458-4220-9a2c-073fbec34b3c req-5b49463b-5285-4e1e-9254-723ad53c5ee1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received unexpected event network-vif-plugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a for instance with vm_state active and task_state None.
May 13 02:15:53.207052 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:53.213019 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638553.2127018, 3fe8732c-63d4-4c50-950b-791d81d36975 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:53.213191 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] VM Resumed (Lifecycle Event)
May 13 02:15:53.230686 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Took 12.62 seconds to build instance.
May 13 02:15:53.715454 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:53.722191 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:15:53.732491 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.136s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:54.898393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.166346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:55.166547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:55.166731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:55.166862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:55.166994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:55.169490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Terminating instance
May 13 02:15:55.608007 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:55.608104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing instance network info cache due to event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:15:55.608348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] Acquiring lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:15:55.608488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] Acquired lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:15:55.608673 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:15:55.672941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:15:55.697674 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.701327 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.725367 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.864112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.869491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.876680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:55.888107 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:55.888319 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:55.888555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:55.888630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:55.888769 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] No waiting events found dispatching network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:55.888880 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bf1e451-f8e9-4c41-9710-2272805bc8d2 req-e660221e-e1d2-49b2-8f92-34fe7c00567d service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:56.031267 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999123862000033 future=<Future at 0x705c6c2bffb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:56.037639 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Instance destroyed successfully.
May 13 02:15:56.038273 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'resources' on Instance uuid fd054b4f-181b-44ac-8e14-86ea3659208c {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:56.111333 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:56.542466 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:13:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-627379103',display_name='tempest-TestVolumeBootPatternV346-server-627379103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-627379103',id=55,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrt70zcdxnPueTjEIhKkVPXhOZJXjkpbqcmLy2SgoHmlDhMCthIsS+fL9fBtJYqduHfTVthoO/FIdDB3fb0d4vkGB40YVqv72sOBPdHC1MLVSN69LzFhLbAWucBBQxqpw==',key_name='tempest-keypair-1201833150',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:14:01Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-fp6ecoue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=fd054b4f-181b-44ac-8e14-86ea3659208c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:15:56.542951 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "3de05011-8c4a-4392-9c34-dc3b51e22887", "address": "fa:16:3e:c1:53:86", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de05011-8c", "ovs_interfaceid": "3de05011-8c4a-4392-9c34-dc3b51e22887", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:15:56.544913 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:15:56.545283 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:15:56.546856 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:56.547187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de05011-8c, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:56.550319 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:56.551273 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:56.559502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:56.559502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e8a6ad9-fe87-4d70-a8b2-2a5b3a02fb28) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:15:56.559502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:15:56.559502 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:56.564579 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:56.566800 np0000000663 nova-compute[98103]: INFO os_vif [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:53:86,bridge_name='br-int',has_traffic_filtering=True,id=3de05011-8c4a-4392-9c34-dc3b51e22887,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de05011-8c')
May 13 02:15:56.569501 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:15:56.569967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:15:56.570160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:15:56.570641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:15:56.570987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6222d865-5c52-4e13-9ce0-c9adfa067fb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:15:56.571185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:15:56.605460 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4 (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:15:56.605682 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:15:56.605823 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '156')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:15:56.606040 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '126')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:56.606929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4', '125')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:15:56.608107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48717f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'): ({'sdh'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:15:56.608107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Removing multipathed devices sdi, sdh {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:15:56.608107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flush multipath device 330000000391b8c72 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:15:56.664533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:56.710594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:15:56.739006 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updated VIF entry in instance network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:15:56.739274 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating instance_info_cache with network_info: [{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:56.764797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:15:56.765006 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:15:56.766131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:15:56.785024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:15:56.785334 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:15:56.800587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.834048 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.40.100,3260]
May 13 02:15:56.834048 np0000000663 nova-compute[98103]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.40.100,3260] successful.
May 13 02:15:56.834048 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.857756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.871924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.910535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.50.100,3260]
May 13 02:15:56.910535 np0000000663 nova-compute[98103]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-6222d865-5c52-4e13-9ce0-c9adfa067fb4, portal: 192.168.50.100,3260] successful.
May 13 02:15:56.910535 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.928359 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:15:56.928650 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:15:56.929047 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== disconnect_volume: return (359ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:15:56.929047 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:15:56.929257 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Deleting instance files /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c_del
May 13 02:15:56.931646 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Deletion of /opt/stack/data/nova/instances/fd054b4f-181b-44ac-8e14-86ea3659208c_del complete
May 13 02:15:57.241675 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e6887c63-3b5f-49b1-b458-a6e82d85d64c req-f468eca2-7ea6-416b-8ea0-a5fdf6e0a0d5 service nova] Releasing lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:15:57.288241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:15:57.436846 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Took 1.76 seconds to destroy the instance on the hypervisor.
May 13 02:15:57.437346 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:15:57.437524 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:15:57.437626 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:15:57.437844 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:57.516668 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:15:58.018303 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:15:58.018551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] Acquiring lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:58.018620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:58.018785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:15:58.018937 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] No waiting events found dispatching network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:15:58.019081 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-55f2bd57-f9b4-429f-8591-162bc99612a1 req-4130b9a5-dba8-4b5c-9c73-144c110405a8 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-unplugged-3de05011-8c4a-4392-9c34-dc3b51e22887 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:15:58.669052 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:15:58.799475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:58.799681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:59.171767 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Took 1.73 seconds to deallocate network for instance.
May 13 02:15:59.308667 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:59.370201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:15:59.371731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:15:59.371731 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:15:59.378688 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98103) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 13 02:15:59.378688 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'flavor' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:15:59.719898 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005543539996324398 future=<Future at 0x705c801eb680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:59.721311 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Emitting event <LifecycleEvent: 1778638544.7192357, b98bc978-d744-41a3-b579-17dc08777b8d => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:15:59.721566 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] VM Stopped (Lifecycle Event)
May 13 02:15:59.724204 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:59.724204 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.6312215279999691 future=<Future at 0x705c487396a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:59.724204 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.631093879999753 future=<Future at 0x705c487396a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:15:59.735817 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:16:00.106181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81410e82-202c-4b5d-8147-738b5e5a063a req-64165d67-b1ad-4308-acd6-276e18c59f44 service nova] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Received event network-vif-deleted-3de05011-8c4a-4392-9c34-dc3b51e22887 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:00.227082 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: b98bc978-d744-41a3-b579-17dc08777b8d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:00.248385 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:00.248604 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:00.319214 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:00.357545 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0022072730002946628 future=<Future at 0x705c487396a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:00.358182 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Emitting event <LifecycleEvent: 1778638545.355211, 96973110-5b6f-4469-8513-47e1f791fa60 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:00.358621 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:00.358621 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=10.670216573999824 future=<Future at 0x705c6c2bffb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:00.358621 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=10.670133619999888 future=<Future at 0x705c6c2bffb0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:00.358781 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] VM Stopped (Lifecycle Event)
May 13 02:16:00.417292 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.422426 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.439574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.451786 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.472300 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.477457 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:00.588613 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:00.588798 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:00.588996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:00.589168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:00.589307 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:00.589456 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-4d8ad3f2-6f5c-47a6-be05-c632925eb314 req-79ab86a1-ca16-456f-8ce6-7e1aabd2eef8 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received unexpected event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with vm_state active and task_state powering-off.
May 13 02:16:00.638177 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:00.638177 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:00.729035 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999714109000251 future=<Future at 0x705c487b6cc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:00.732706 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance destroyed successfully.
May 13 02:16:00.733189 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'numa_topology' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:00.863200 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-5324be52-6df7-40f3-8162-f49633548462 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 96973110-5b6f-4469-8513-47e1f791fa60] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:00.864465 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:01.142557 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:01.237488 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:01.241111 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:01.494559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:01.494559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:01.494749 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Attaching volume e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 to /dev/vdb
May 13 02:16:01.542703 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:01.555617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:01.557513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:16:01.583492 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:01.636556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:16:01.636930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:16:01.645348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:16:01.646604 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fe59:2621', 'fe80::a8ce:a8ff:fe4b:3e5', 'fe80::fc16:3eff:fe24:96f'] 
May 13 02:16:01.646741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:16:01.646817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:16:01.647112 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:01.647342 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating existing volume attachment record: 2eab3ec9-a6c3-4282-a4c7-16d2fd2beed9 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:16:01.653559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:01.715438 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Deleted allocations for instance fd054b4f-181b-44ac-8e14-86ea3659208c
May 13 02:16:01.746245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-249c765b-192a-4feb-8336-b1767542f650 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.375s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:02.270250 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '84dee6c9-e7c2-44ef-a37f-f4b8707326b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'serial': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:16:02.274002 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:16:02.274751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:02.274751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:02.275355 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:02.275640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:16:02.290344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:02.291117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:02.291836 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:02.292123 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:02.292937 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:02.293480 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:02.309072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:02.309072 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:02.317125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:02.317125 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:02.322952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2] added
May 13 02:16:02.322952 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:02.322952 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:02.322952 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:02.322952 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:02.322952 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:02.322952 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:02.323476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:02.323476 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:02.323476 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:02.326417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2] added
May 13 02:16:02.326417 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:02.326417 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:02.326417 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:02.326417 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:02.326417 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:02.326417 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:02.326573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:02.326699 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:02.326942 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:02.651176 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:02.651933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:02.651933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:02.652041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:02.652193 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:02.652376 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-1c0724b8-c43f-4b48-9deb-a519106e1066 req-b7cc2f72-7744-4632-b914-114e304ec665 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received unexpected event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with vm_state stopped and task_state None.
May 13 02:16:02.726882 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a0eaddcb-1e9d-4c7d-8a3c-1d677ff787ca tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "fd054b4f-181b-44ac-8e14-86ea3659208c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.560s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:03.323817 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:03.327615 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:03.341342 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:03.341342 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:03.347265 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.347265 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'flavor' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:03.357703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.362681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.376520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.376520 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.376520 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.376520 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.376520 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.376520 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:03.376717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.376717 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.376717 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.376717 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.376717 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.376717 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:03.380758 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.380758 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.380758 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.380758 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.380758 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.380758 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:03.380946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.380946 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.380946 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.380946 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.380946 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.380946 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:03.416517 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.50.100,3260]
May 13 02:16:03.416517 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.50.100,3260] successful.
May 13 02:16:03.416517 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.428712 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.40.100,3260]
May 13 02:16:03.428712 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.40.100,3260] successful.
May 13 02:16:03.428712 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.435346 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.444323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.455184 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('11', '-', '-', 0) found on session 157 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:03.455184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.462270 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:03.462448 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:03.462700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:03.462821 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:03.463771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('12', '-', '-', 0) found on session 158 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:03.463928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:03.472465 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 157 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:03.472465 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:03.482891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 158 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:03.482891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:03.852865 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:03.853010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:03.853153 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:16:03.853332 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'info_cache' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:04.293243 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:16:04.355652 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,info_cache {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:04.857869 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:05.142465 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.142704 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.142938 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.143199 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.143418 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.143651 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.143880 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.144141 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.144304 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:16:05.144521 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:16:05.155980 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:05.307117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:05.311332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found WWN 3300000004924f42f for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:16:05.311623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:05.314046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000004924f42f', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004924f42f'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:05.314226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004924f42f', 'path': '/dev/disk/by-id/os-brick+dev+dm-4', 'multipath_id': '3300000004924f42f'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:16:05.316494 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:16:05.316623 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:16:05.316850 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:16:05.336645 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.luks [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 02:16:05.336933 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:16:05.337060 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:16:05.337230 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:16:05.337630 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x705c6c28d580>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '84dee6c9-e7c2-44ef-a37f-f4b8707326b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'serial': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:16:05.337751 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] formatting encrypted volume /dev/dm-4 {{(pid=98103) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 02:16:05.648922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:05.649439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:05.649439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:05.649439 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:16:05.811339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-40182305-b217-4ea3-bb1a-09b673321381" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:05.867307 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.175820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:06.176108 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:06.176277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:06.178131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:06.178337 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:06.184010 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Terminating instance
May 13 02:16:06.556634 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.677629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:06.699115 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:16:06.740887 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.746390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.773924 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.773924 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.797653 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:06.798882 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:06.813680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:06.844429 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance destroyed successfully.
May 13 02:16:06.845462 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'numa_topology' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:06.916011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:06.922661 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:06.941980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:06.945472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:06.945853 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:06.946107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:06.946348 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] No waiting events found dispatching network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:06.946539 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9fb72dd8-86a2-4e2e-825b-1c33ebac677d req-f6cf1b74-1f81-4407-b9b3-336327b7c5e9 service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:07.042937 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:07.043560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:07.044447 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999502095000025 future=<Future at 0x705c6c2b6120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:07.067131 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Instance destroyed successfully.
May 13 02:16:07.068119 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lazy-loading 'resources' on Instance uuid acca535f-2ccf-44dc-b45b-1587bcc4561a {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:07.151000 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:07.154289 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:16:07.156133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:16:07.158474 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:07.159444 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:07.212562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:07.213397 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12731MB free_disk=72.85834121704102GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:16:07.213955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:07.214290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:07.348926 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:07.350488 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:07.575474 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:12:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-560457363',display_name='tempest-TestVolumeBootPatternV346-server-560457363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpatternv346-server-560457363',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZgBiik/d00pl/LysR7NbLbEx8WOlXshAiYHABdO+pl3pDu1X/5kFrLeUOZ7F4FebX9d4FtwAyLxX+lV2OtqsRRVM1MCwpq/CxkEKXEpMwG99YXcqIM1w3S/OEurLuKbQ==',key_name='tempest-keypair-1213351973',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:12:54Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0787f738661944129f59b1250bc5e71e',ramdisk_id='',reservation_id='r-xu17ldyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1111989009',owner_user_name='tempest-TestVolumeBootPatternV346-1111989009-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b8648b9097814fd5848d1e51cbecf9a6',uuid=acca535f-2ccf-44dc-b45b-1587bcc4561a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:16:07.575748 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converting VIF {"id": "471b8737-87e1-4198-8334-5621db2cf383", "address": "fa:16:3e:59:26:21", "network": {"id": "a8ba063b-7896-4dfd-9d5d-fa93169edbaf", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1231589850-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0787f738661944129f59b1250bc5e71e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b8737-87", "ovs_interfaceid": "471b8737-87e1-4198-8334-5621db2cf383", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:07.576576 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:07.577079 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:16:07.580163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.580553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471b8737-87, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:07.587617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.589795 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:07.594661 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.595810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.596036 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5c21064-243b-4047-921a-164386c80734) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:07.597573 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.598070 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:07.605874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.608907 np0000000663 nova-compute[98103]: INFO os_vif [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:26:21,bridge_name='br-int',has_traffic_filtering=True,id=471b8737-87e1-4198-8334-5621db2cf383,network=Network(a8ba063b-7896-4dfd-9d5d-fa93169edbaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b8737-87')
May 13 02:16:07.611733 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:16:07.612344 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:07.612673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:07.852606 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:07.853401 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:16:07.853584 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:07.854125 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:07.854349 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:16:07.855067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.855270 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap059fb0c1-98, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:07.856147 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.857734 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:07.858336 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.858470 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9390ca30-0ad9-45dd-9464-525c5e44bdc7) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:07.858906 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.859356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:07.860006 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:07.863271 np0000000663 nova-compute[98103]: INFO os_vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98')
May 13 02:16:07.864911 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:16:07.865202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:07.865329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:08.294732 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance acca535f-2ccf-44dc-b45b-1587bcc4561a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:16:08.294880 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 40182305-b217-4ea3-bb1a-09b673321381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:16:08.295070 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:16:08.295253 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 3fe8732c-63d4-4c50-950b-791d81d36975 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:16:08.295462 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:16:08.295635 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:16:07 up 40 min,  2 users,  load average: 7.04, 7.49, 5.29\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_deleting': '1', 'num_os_type_None': '4', 'num_proj_0787f738661944129f59b1250bc5e71e': '1', 'io_workload': '0', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1', 'num_task_None': '2', 'num_proj_cf4cdaf6da19497586ec83765be014b7': '1', 'num_proj_9b5475f08f0a44c4a95ec0ce67c5f366': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:16:08.466144 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.853s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:08.466644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:16:08.466858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.500996 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsi session list stdout=tcp: [113] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.501360 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:08.501360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710', '160')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:16:08.501601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '114')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:08.502805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e', '113')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:08.503723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6aa660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:16:08.503723 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Removing multipathed devices sdb, sde {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:16:08.503935 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Flush multipath device 330000000cc36192a {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:16:08.556738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:08.577949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:08.578413 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:08.604063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:08.649552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if SCSI volumes sdb, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:16:08.649736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] SCSI volumes sdb, sde have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:16:08.651003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Checking to see if device paths {'sdb', 'sde'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:16:08.664742 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Device paths {'sdb', 'sde'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:16:08.665039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:16:08.677992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.712644 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.40.100,3260]
May 13 02:16:08.712644 np0000000663 nova-compute[98103]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.40.100,3260] successful.
May 13 02:16:08.712644 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.730707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.744725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.783577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.50.100,3260]
May 13 02:16:08.783577 np0000000663 nova-compute[98103]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-9e9d715f-d6eb-4864-bcf7-3c215a359c9e, portal: 192.168.50.100,3260] successful.
May 13 02:16:08.783577 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.799840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:08.800051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:08.800215 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] <== disconnect_volume: return (1187ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:08.800374 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:16:08.800637 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Deleting instance files /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a_del
May 13 02:16:08.801026 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.936s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:08.801303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:16:08.801708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:16:08.801930 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Deletion of /opt/stack/data/nova/instances/acca535f-2ccf-44dc-b45b-1587bcc4561a_del complete
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [149] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [150] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [156] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:08.830216 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '156'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710', '160')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:16:08.830216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '149')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:08.831007 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '150')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:08.832441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6aa660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'): ({'sdm'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:16:08.832441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdm, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:16:08.832441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 3300000008297f78b {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:16:08.890952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:08.934416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:08.990556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdm, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:16:08.990776 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdm, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:16:08.991884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdm', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:16:08.996649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:08.996812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] Acquiring lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:08.996994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:08.997117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:08.997294 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] No waiting events found dispatching network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:08.997423 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0acf6142-bad8-4dc0-9194-c9cc386e29c4 req-5516e87e-4a97-41d5-883b-cd4a0267a1ec service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-unplugged-471b8737-87e1-4198-8334-5621db2cf383 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:09.007730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdm', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:16:09.007910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:16:09.019250 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.054746 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260]
May 13 02:16:09.054746 np0000000663 nova-compute[98103]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260] successful.
May 13 02:16:09.054746 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.073211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.082072 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:09.090050 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.126970 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260]
May 13 02:16:09.126970 np0000000663 nova-compute[98103]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260] successful.
May 13 02:16:09.126970 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.143343 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.143587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:09.143747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (1278ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:09.143921 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:16:09.151839 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start _get_guest_xml network_info=[{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '40182305-b217-4ea3-bb1a-09b673321381', 'attached_at': '', 'detached_at': '', 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'serial': '426820d4-748c-4053-9d82-e2d0681ee491'}, 'attachment_id': '9e7c9717-68ff-4565-93b4-a8d0f21f3937', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:16:09.157727 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:09.159031 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1493331219', uuid='40182305-b217-4ea3-bb1a-09b673321381'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638569.1586263) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:16:09.160595 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:16:09.160952 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:16:09.161893 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:16:09.162072 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:16:09.166169 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:09.309467 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Took 2.61 seconds to destroy the instance on the hypervisor.
May 13 02:16:09.310161 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:16:09.310455 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:16:09.310567 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:16:09.313559 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:09.360115 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:16:09.360115 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:16:09.360115 np0000000663 nova-compute[98103]:     <volume>e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2</volume>
May 13 02:16:09.360115 np0000000663 nova-compute[98103]:   </usage>
May 13 02:16:09.360115 np0000000663 nova-compute[98103]: </secret>
May 13 02:16:09.360115 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:16:09.373065 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:09.382253 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:09.590710 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:16:09.590903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.377s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:09.591384 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:16:09.667000 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:09.683345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:09.792295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:09.793151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:09.793442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:09.795562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:09.795562 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:16:09.795562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:09.795562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:09.796615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:09.797353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:16:09.814617 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:09.815023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:09.815334 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:09.816019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:09.816793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:09.817880 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:09.827686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:09.827686 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.836747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:09.836747 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.847160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491] added
May 13 02:16:09.847160 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:09.847160 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:09.847160 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:09.847160 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:09.847160 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:09.847160 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.847495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:09.847608 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:09.847658 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491] added
May 13 02:16:09.851973 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:09.851973 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:09.851973 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:09.878248 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Attempting to attach volume e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:16:09.880583 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <alias name="ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2"/>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <serial>e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2</serial>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="d4ee0734-75cd-4a58-b634-7b59a5810622"/>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:09.880583 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:16:10.174789 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:16:10.324220 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:10.831119 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Took 1.52 seconds to deallocate network for instance.
May 13 02:16:10.848581 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:10.853228 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:10.866106 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:10.866106 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.870329 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:10.872743 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:10.872743 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.883379 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.894532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.902396 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.902396 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.902396 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.902396 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.902396 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:10.902696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.902696 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.902696 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.902696 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.902696 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:10.914420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.914420 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.914420 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.914420 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.914420 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:10.914727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.914727 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.914727 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.914727 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.914727 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:10.944571 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260]
May 13 02:16:10.944571 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260] successful.
May 13 02:16:10.944571 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.960773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.970444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260]
May 13 02:16:10.970444 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260] successful.
May 13 02:16:10.970444 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:10.981904 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('7', '-', '-', 0) found on session 161 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:10.981904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:10.983946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:11.002075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 161 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:11.002075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-51f8af93-aadc-4fcf-b702-94eb21ecf710 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:11.007789 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:11.007789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:11.009575 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 162 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:11.009575 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:11.030254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 162 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:11.030254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:11.032963 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.004194459000245843 future=<Future at 0x705c6c2bffb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:11.033735 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:11.034002 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.694498938999914 future=<Future at 0x705c487b6cc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:11.034501 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.694361234000098 future=<Future at 0x705c487b6cc0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:11.034969 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] Emitting event <LifecycleEvent: 1778638556.0281274, fd054b4f-181b-44ac-8e14-86ea3659208c => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:11.036467 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] VM Stopped (Lifecycle Event)
May 13 02:16:11.095181 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-51b035bd-bdf2-4ba9-8566-ea3b3c597a8f req-8eb7db91-2dd8-4596-9a71-6da1073d489b service nova] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Received event network-vif-deleted-471b8737-87e1-4198-8334-5621db2cf383 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:11.407977 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Took 0.58 seconds to detach 1 volumes for instance.
May 13 02:16:11.539000 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e313fc2f-51fa-45bd-90b3-db01eea80fa0 tempest-AttachVolumeShelveTestJSON-970754436 tempest-AttachVolumeShelveTestJSON-970754436-project-member] [instance: fd054b4f-181b-44ac-8e14-86ea3659208c] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:11.817722 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:16:11.916374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:11.916619 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:12.140347 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:12.140655 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:12.539865 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:12.540287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:12.540287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:12.540287 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:24:09:6f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:12.643109 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:12.834779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 3300000008297f78b for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:16:12.834992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:12.835260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000008297f78b', 'path': '/dev/dm-0', 'multipath_id': '3300000008297f78b'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:12.835328 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008297f78b', 'path': '/dev/dm-0', 'multipath_id': '3300000008297f78b'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:16:12.859537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.151481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.235s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:13.215782 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Deleted allocations for instance acca535f-2ccf-44dc-b45b-1587bcc4561a
May 13 02:16:13.263438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:13.263602 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:13.340658 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:16:13.340819 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:13.341490 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:13.342375 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:13.765110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:16:13.845994 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Object Instance<40182305-b217-4ea3-bb1a-09b673321381> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:16:13.846740 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] End _get_guest_xml xml=<domain type="qemu">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <uuid>40182305-b217-4ea3-bb1a-09b673321381</uuid>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <name>instance-0000003c</name>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-1493331219</nova:name>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:16:09</nova:creationTime>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         <nova:port uuid="059fb0c1-9865-4348-bf5f-8056dbe21fbf">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <system>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="serial">40182305-b217-4ea3-bb1a-09b673321381</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="uuid">40182305-b217-4ea3-bb1a-09b673321381</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </system>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <os>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </os>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <features>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </features>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   <devices>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/disk.config"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <alias name="ua-426820d4-748c-4053-9d82-e2d0681ee491"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <serial>426820d4-748c-4053-9d82-e2d0681ee491</serial>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:8b:7c:fc"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <target dev="tap059fb0c1-98"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </interface>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381/console.log" append="off"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </serial>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <video>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </video>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </rng>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:   </devices>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]: </domain>
May 13 02:16:13.846740 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:16:13.849620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:16:13.849620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:16:13.849620 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:13.849620 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:13.849620 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:16:13.850079 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.850079 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:13.850562 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:16:13.850698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.850965 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89eb48e4-b4e3-5b05-9fed-95219c7c5484', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:13.852228 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.852557 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:13.853515 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.855842 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.856049 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap059fb0c1-98, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:13.856410 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap059fb0c1-98, col_values=(('qos', UUID('19eed704-5416-4cce-aa2e-6e70c6b9d24b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:13.856579 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap059fb0c1-98, col_values=(('external_ids', {'iface-id': '059fb0c1-9865-4348-bf5f-8056dbe21fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:7c:fc', 'vm-uuid': '40182305-b217-4ea3-bb1a-09b673321381'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:13.857484 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.858669 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:13.863946 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:13.865000 np0000000663 nova-compute[98103]: INFO os_vif [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98')
May 13 02:16:14.086173 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-445fcc1a-4da5-4a40-a101-b5614c446ff2 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.592s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:14.226563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-faa3531c-fe7a-49ab-87bc-0daaba350b4a tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Lock "acca535f-2ccf-44dc-b45b-1587bcc4561a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.051s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:14.310833 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:14.310969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:14.315901 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:16:14.316012 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Claim successful on node np0000000663
May 13 02:16:14.322933 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.352768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.448919 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.519205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:14.519205 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:14.615011 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:14.615219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:14.615378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:14.615504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:14.615654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:14.615723 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-45179103-2277-4a44-a6e8-0d7eab79f2d3 req-3405bf77-bc92-4ed4-a0df-a476884fb843 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received unexpected event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with vm_state stopped and task_state powering-on.
May 13 02:16:14.644267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.647264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.650320 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.673875 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:14.676314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:15.020533 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Detaching volume e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2
May 13 02:16:15.068655 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Attempting to driver detach volume e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 from mountpoint /dev/vdb
May 13 02:16:15.119763 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, 'status': 'reserved', 'instance': '84dee6c9-e7c2-44ef-a37f-f4b8707326b7', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'serial': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:16:15.125502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:16:15.127064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:16:15.127315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Attempting to detach device vdb from instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:16:15.128015 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <alias name="ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <serial>e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2</serial>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="d4ee0734-75cd-4a58-b634-7b59a5810622"/>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:15.128015 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:16:15.136558 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 from the persistent domain config.
May 13 02:16:15.136874 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] (1/8): Attempting to detach device vdb with device alias ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 from instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:16:15.137291 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <alias name="ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-4"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <serial>e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2</serial>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="d4ee0734-75cd-4a58-b634-7b59a5810622"/>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:15.137291 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:16:15.202751 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 40182305-b217-4ea3-bb1a-09b673321381 due to new event <LifecycleEvent: 1778638575.2022738, 40182305-b217-4ea3-bb1a-09b673321381 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:16:15.202751 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638575.2022738, 40182305-b217-4ea3-bb1a-09b673321381 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:15.202918 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Resumed (Lifecycle Event)
May 13 02:16:15.204345 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:16:15.207401 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance rebooted successfully.
May 13 02:16:15.599255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:15.599509 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:15.706609 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:15.710293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:15.728991 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00042719199973362265 future=<Future at 0x705c487b6cc0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:15.729361 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:15.729361 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.314395128999877 future=<Future at 0x705c6c2b6120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:15.730514 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.3131776669997635 future=<Future at 0x705c6c2b6120 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:15.732044 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 for instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:16:15.870339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:16.103419 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:16.215892 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 02:16:16.215892 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638576.2154968, 40182305-b217-4ea3-bb1a-09b673321381 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:16.216219 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Started (Lifecycle Event)
May 13 02:16:16.616523 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.305s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:16.616804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:16:16.701079 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:16.701312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:16.701485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:16.701721 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:16.702077 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:16.707433 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ba283f7f-dd69-4ccc-a7da-f5882af761bc req-accce0eb-b5bf-4d93-893d-f5e4b148e51c service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received unexpected event network-vif-plugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with vm_state stopped and task_state powering-on.
May 13 02:16:16.719362 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:16.723947 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:16.728040 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:16.728267 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:16.728399 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:8b:7c:fc, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:16.728862 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e690b85d-2ae4-4272-ad38-f7e7f8c183e0 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:17.124497 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:16:17.124923 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:16:17.125014 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:17.125200 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:17.215775 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d325d0dba64ea3b96f96d326512846', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f78524b7a74be2affb10b0321431d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:16:17.230516 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 40182305-b217-4ea3-bb1a-09b673321381] During sync_power_state the instance has a pending task (powering-on). Skip.
May 13 02:16:17.234249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638577.2306244, 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 => ua-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:16:17.234249 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 from the live domain config.
May 13 02:16:17.249550 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:16:17.250379 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:17.250379 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:17.250563 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:17.250942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:16:17.251196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:16:17.291598 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:17.291598 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:17.291598 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:17.291598 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:17.291598 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:17.291921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [157] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:17.291921 np0000000663 nova-compute[98103]: tcp: [158] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2 (non-flash)
May 13 02:16:17.291921 np0000000663 nova-compute[98103]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:17.291921 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:17.291921 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:17.291921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '157'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '162')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:16:17.292076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '158')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:17.292927 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2', '157')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:17.293743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c70b6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'): ({'sdf'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:16:17.293875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:16:17.294130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flush multipath device 3300000004924f42f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:16:17.333043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:17.376265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:17.423971 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:16:17.424205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:16:17.425069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:16:17.441502 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:16:17.441732 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:16:17.459139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.497875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.40.100,3260]
May 13 02:16:17.497875 np0000000663 nova-compute[98103]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.40.100,3260] successful.
May 13 02:16:17.497875 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.526337 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.541436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.587137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.50.100,3260]
May 13 02:16:17.587137 np0000000663 nova-compute[98103]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-e3d13537-56b2-4ea2-9945-bf1d7c4f2cc2, portal: 192.168.50.100,3260] successful.
May 13 02:16:17.587137 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.607819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:17.610717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:17.611676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== disconnect_volume: return (361ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:17.611676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:16:17.633998 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:16:17.653162 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:17.816222 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-98a147bb-04c5-4938-b49a-c9056fd5eb51 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Get console output
May 13 02:16:17.822684 np0000000663 nova-compute[98103]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 13 02:16:17.888551 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Successfully created port: 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:16:18.137735 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:16:18.220455 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:18.528263 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Successfully updated port: 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:16:18.603754 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:18.603754 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing instance network info cache due to event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:18.603754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:18.603754 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:18.603754 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:18.645730 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Booting with volume 659a8bdf-b47f-4597-a4f8-a6f7f032fb0d at /dev/vda
May 13 02:16:18.706721 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:18.723260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:16:18.751162 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:18.802665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:16:18.803005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:16:18.816603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:16:18.817740 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fe8b:7cfc', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe24:96f'] 
May 13 02:16:18.817895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:16:18.817983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:16:18.818226 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:18.818460 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating existing volume attachment record: 7c71f92b-4820-4a9f-8188-b22975a438e1 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:16:18.859813 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:19.030339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:19.107492 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:19.201445 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:19.232252 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-b6d76032-ea3f-4d63-9501-735e5024894f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.714s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:19.395836 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:19.898639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-62bb0049-4e23-46cb-906d-b83cb1460df2 req-fe601b92-a6c1-4bca-b9f3-c5e6f2532006 service nova] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:19.900140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:19.900140 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:16:20.023080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.023241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.023456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.023612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.023750 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:20.026105 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Terminating instance
May 13 02:16:20.057235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.057452 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.057629 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.057832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.057975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:20.061425 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Terminating instance
May 13 02:16:20.071843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.487360 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:20.529936 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:16:20.557162 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.561002 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.566761 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:16:20.588293 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.592551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.621433 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.626835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.655490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.701232 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:20.721382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.751947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.760896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:20.800127 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-777c8041-ad7c-4618-863a-6ae444cf703e req-1adf142f-020e-4911-bb0e-a064c24176e7 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:20.874298 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:20.950089 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:20.953076 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:16:20.957360 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:16:20.959245 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Creating image(s)
May 13 02:16:20.959995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:16:20.960210 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Ensure instance console log exists: /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:16:20.960908 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:20.961157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:20.961360 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:20.970757 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.004835 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999646201999894 future=<Future at 0x705c6c190e60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:21.011424 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.014171 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999764401999983 future=<Future at 0x705c6c2801a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:21.020354 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Instance destroyed successfully.
May 13 02:16:21.021174 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'resources' on Instance uuid 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:21.024414 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Instance destroyed successfully.
May 13 02:16:21.025040 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 40182305-b217-4ea3-bb1a-09b673321381 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:21.169343 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:21.169540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:21.169930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:21.169930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:21.169930 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] No waiting events found dispatching network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:21.170228 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5d90a293-db81-47aa-a6bb-48cd90dc7e39 req-1cea5bce-10ed-407c-83c3-3ae132b41a86 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:21.318504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.329289 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.335191 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.367584 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.377983 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.461741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:21.461741 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance network_info: |[{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:16:21.462767 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Start _get_guest_xml network_info=[{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd1b58792-6c38-4e10-8f6e-8382d97d9bbe', 'attached_at': '', 'detached_at': '', 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'serial': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'}, 'attachment_id': '7c71f92b-4820-4a9f-8188-b22975a438e1', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:16:21.470873 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:21.472363 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1112809753', uuid='d1b58792-6c38-4e10-8f6e-8382d97d9bbe'), owner=OwnerMeta(userid='53d325d0dba64ea3b96f96d326512846', username='tempest-TestVolumeBackupRestore-607996593-project-member', projectid='05f78524b7a74be2affb10b0321431d8', projectname='tempest-TestVolumeBackupRestore-607996593'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638581.4718778) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:16:21.473897 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:16:21.474377 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:16:21.476826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:16:21.476826 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:16:21.477991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:16:21.478693 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:16:21.478875 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:16:21.479018 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:16:21.479217 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:16:21.479344 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:16:21.479489 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:16:21.479694 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:16:21.479848 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:16:21.479993 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:16:21.480210 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:16:21.481232 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:16:21.499267 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.515143 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:16:21.515622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:21.515817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:21.524113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1957344971',display_name='tempest-TestEncryptedCinderVolumes-server-1957344971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1957344971',id=61,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/UK17ZVIzXIpVq8QKgVhfRWXC1CeB2h17eXycHatPa0uzWATW8KREOdZomWDPgIrFROqPBZFpHP+7ZwNfS0TnmiYiUJi7Ovef+6sCuJr5VFgG18giur3ENGaL/iTZR/A==',key_name='tempest-keypair-985510521',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-a8x81jnu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:15:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=84dee6c9-e7c2-44ef-a37f-f4b8707326b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:16:21.524451 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "9323fc02-c359-4327-a3d9-14269b62beae", "address": "fa:16:3e:24:09:6f", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9323fc02-c3", "ovs_interfaceid": "9323fc02-c359-4327-a3d9-14269b62beae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:21.525511 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:21.525511 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:16:21.531743 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.533512 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1493331219',display_name='tempest-TestVolumeBootPattern-server-1493331219',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1493331219',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBjnA/4McYlNoW7ZXgvBUEozrCvDN3MpQmWkCv+5bjpWKLluARRYb5l/NfouuPilHVaMWTpMfH/ohemt+v3VxYVDroffdlo+ASdgrJMBw3sHg9nKrCMhhaH2UxbPZTzdw==',key_name='tempest-keypair-401880806',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:19Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-lmlc8kru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=40182305-b217-4ea3-bb1a-09b673321381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:16:21.534684 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "address": "fa:16:3e:8b:7c:fc", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap059fb0c1-98", "ovs_interfaceid": "059fb0c1-9865-4348-bf5f-8056dbe21fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:21.535467 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:21.535971 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:16:21.536199 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.537114 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9323fc02-c3, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:21.538994 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.539944 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:21.550982 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.551541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.552537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap059fb0c1-98, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:21.553681 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.554415 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:21.559227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.560083 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.560610 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=286feb2d-7030-4a15-8753-3e88c11ce592) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:21.561596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.562560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:21.563819 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.564849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.564943 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19eed704-5416-4cce-aa2e-6e70c6b9d24b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:21.566386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:21.567692 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:21.568589 np0000000663 nova-compute[98103]: INFO os_vif [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:09:6f,bridge_name='br-int',has_traffic_filtering=True,id=9323fc02-c359-4327-a3d9-14269b62beae,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9323fc02-c3')
May 13 02:16:21.569226 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Deleting instance files /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7_del
May 13 02:16:21.571564 np0000000663 nova-compute[98103]: INFO os_vif [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7c:fc,bridge_name='br-int',has_traffic_filtering=True,id=059fb0c1-9865-4348-bf5f-8056dbe21fbf,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap059fb0c1-98')
May 13 02:16:21.573035 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Deletion of /opt/stack/data/nova/instances/84dee6c9-e7c2-44ef-a37f-f4b8707326b7_del complete
May 13 02:16:21.577081 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:16:21.577456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:21.577586 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:22.044206 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00046230599991758936 future=<Future at 0x705c6c2b6120 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:22.044350 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:22.044500 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.959952549999798 future=<Future at 0x705c6c190e60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:22.044579 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=13.959844339000028 future=<Future at 0x705c6c190e60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:22.045123 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Emitting event <LifecycleEvent: 1778638567.0436192, acca535f-2ccf-44dc-b45b-1587bcc4561a => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:22.045373 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] VM Stopped (Lifecycle Event)
May 13 02:16:22.081586 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Took 1.55 seconds to destroy the instance on the hypervisor.
May 13 02:16:22.082124 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:16:22.082357 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:16:22.082446 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:16:22.083149 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:22.151389 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:22.548260 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: acca535f-2ccf-44dc-b45b-1587bcc4561a] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:22.865662 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:22.866196 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] Acquiring lock "40182305-b217-4ea3-bb1a-09b673321381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:22.866392 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:22.866516 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] Lock "40182305-b217-4ea3-bb1a-09b673321381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:22.866652 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] No waiting events found dispatching network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:22.866857 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-unplugged-059fb0c1-9865-4348-bf5f-8056dbe21fbf for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:22.866995 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-deleted-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:22.867124 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Neutron deleted interface 9323fc02-c359-4327-a3d9-14269b62beae; detaching it from the instance and deleting it from the info cache
May 13 02:16:22.868187 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:23.111658 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] Acquiring lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] No waiting events found dispatching network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:23.247080 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9065d0d8-0a05-46fd-b589-f171aefd81df req-13d6e7b1-ddfe-44c0-bca7-a8d848057628 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Received event network-vif-unplugged-9323fc02-c359-4327-a3d9-14269b62beae for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:16:23.371207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd48c30c-8a56-40f5-8525-644cd2df5eba req-c9a45b94-e5de-47d8-af84-64d4c0efd8c6 service nova] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Detach interface failed, port_id=9323fc02-c359-4327-a3d9-14269b62beae, reason: Instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:16:23.375607 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.860s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:23.375915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:16:23.387608 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:23.388405 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:23.388834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:23.389008 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:23.389523 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:23.389853 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:23.401934 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:23.401934 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:23.407260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:23.407260 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:23.413108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d] added
May 13 02:16:23.413108 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:23.413108 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:23.413108 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:23.413108 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:23.413108 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:23.413108 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:23.413298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:23.413504 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:23.413693 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:23.422866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d] added
May 13 02:16:23.422866 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:23.422866 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:23.422866 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:23.422866 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:23.422866 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:23.422866 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:23.423221 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:23.423254 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:23.423408 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:23.614135 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Took 1.53 seconds to deallocate network for instance.
May 13 02:16:24.122240 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:24.122442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:24.387255 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:24.387493 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:24.414222 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:24.424156 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:24.430116 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:24.430116 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:24.437211 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:24.437211 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.447146 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.455270 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.462293 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.462293 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.462293 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.462293 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.462293 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:24.462531 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.462531 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.462531 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.462531 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.462531 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.468745 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:24.508240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.40.100,3260]
May 13 02:16:24.508240 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.40.100,3260] successful.
May 13 02:16:24.508240 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.514296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.50.100,3260]
May 13 02:16:24.514296 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.50.100,3260] successful.
May 13 02:16:24.514296 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.522803 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.528570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.539692 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.539933 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:24.540246 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:24.540388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:24.541109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] HCTL ('11', '-', '-', 0) found on session 165 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:24.541255 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:24.547932 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] HCTL ('12', '-', '-', 0) found on session 166 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:24.547932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:24.556051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:24.578894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching for a device in session 166 and hctl ['12', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:24.890049 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:25.396621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.274s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:25.442702 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deleted allocations for instance 84dee6c9-e7c2-44ef-a37f-f4b8707326b7
May 13 02:16:25.555747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching for a device in session 165 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:25.556627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:25.572191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Searching for a device in session 166 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:25.572350 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:25.886479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:26.389651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:16:26.451829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-61359c19-ac13-44f6-85f1-2b75bb403be8 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "84dee6c9-e7c2-44ef-a37f-f4b8707326b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.428s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:26.566544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:27.402946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Found WWN 3300000005a0394d6 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:16:27.403327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:27.403327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] <== connect_volume: return (5887ms) {'type': 'block', 'scsi_wwn': '3300000005a0394d6', 'path': '/dev/dm-4', 'multipath_id': '3300000005a0394d6'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:27.403442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005a0394d6', 'path': '/dev/dm-4', 'multipath_id': '3300000005a0394d6'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:16:27.403765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.826s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:27.404046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '426820d4-748c-4053-9d82-e2d0681ee491', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:16:27.404191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:27.425426 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491 (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: tcp: [163] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: tcp: [164] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55 (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:27.425654 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:27.425793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '162'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55', '163'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-efdc0cb2-1761-46e4-98aa-e5226739bc55', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '166')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:16:27.425852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '161')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:27.426878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491', '162')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:27.427572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6a85e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:16:27.427770 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:16:27.428063 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 3300000008297f78b {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:16:27.475377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:27.518352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:27.564788 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:16:27.564982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:16:27.565973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:16:27.578223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:16:27.578408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:16:27.591698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.628311 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260]
May 13 02:16:27.628311 np0000000663 nova-compute[98103]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.40.100,3260] successful.
May 13 02:16:27.628311 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.644336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.656442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.685780 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260]
May 13 02:16:27.685780 np0000000663 nova-compute[98103]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-426820d4-748c-4053-9d82-e2d0681ee491, portal: 192.168.50.100,3260] successful.
May 13 02:16:27.685780 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.697880 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:27.698051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:27.698178 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (6120ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:27.698286 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:16:27.698489 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Deleting instance files /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381_del
May 13 02:16:27.698910 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Deletion of /opt/stack/data/nova/instances/40182305-b217-4ea3-bb1a-09b673321381_del complete
May 13 02:16:27.908391 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1112809753',display_name='tempest-TestVolumeBackupRestore-server-1112809753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebackuprestore-server-1112809753',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmIIVMyKvX+FfQwiNfRAJzQJYbY4u/xp4Lo/so2jCelpIHgFG6ALY6nbjvelBiTx36OuBPy6hmpI7z/kfZUyGjFLtO/Mp+l6eNOOAgUnwbTdQ3LD323svo65RFmqrfXvA==',key_name='tempest-TestVolumeBackupRestore-423350767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f78524b7a74be2affb10b0321431d8',ramdisk_id='',reservation_id='r-3btk0utw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-607996593',owner_user_name='tempest-TestVolumeBackupRestore-607996593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:18Z,user_data=None,user_id='53d325d0dba64ea3b96f96d326512846',uuid=d1b58792-6c38-4e10-8f6e-8382d97d9bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:16:27.908391 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converting VIF {"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:27.908859 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:27.909462 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lazy-loading 'pci_devices' on Instance uuid d1b58792-6c38-4e10-8f6e-8382d97d9bbe {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:28.204042 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Took 7.64 seconds to destroy the instance on the hypervisor.
May 13 02:16:28.205958 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:16:28.206254 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:16:28.206369 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:16:28.206536 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:28.260401 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:28.411842 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] End _get_guest_xml xml=<domain type="qemu">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <uuid>d1b58792-6c38-4e10-8f6e-8382d97d9bbe</uuid>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <name>instance-0000003f</name>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBackupRestore-server-1112809753</nova:name>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:16:21</nova:creationTime>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:user uuid="53d325d0dba64ea3b96f96d326512846">tempest-TestVolumeBackupRestore-607996593-project-member</nova:user>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:project uuid="05f78524b7a74be2affb10b0321431d8">tempest-TestVolumeBackupRestore-607996593</nova:project>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         <nova:port uuid="732dc8c0-3256-493b-9052-13598ff9b65a">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <system>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="serial">d1b58792-6c38-4e10-8f6e-8382d97d9bbe</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="uuid">d1b58792-6c38-4e10-8f6e-8382d97d9bbe</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </system>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <os>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </os>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <features>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </features>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   <devices>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/disk.config"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <alias name="ua-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-4"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <serial>659a8bdf-b47f-4597-a4f8-a6f7f032fb0d</serial>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:f4:88:b8"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <target dev="tap732dc8c0-32"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </interface>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/console.log" append="off"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </serial>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <video>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </video>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </rng>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:   </devices>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]: </domain>
May 13 02:16:28.411842 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Preparing to wait for external event network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1112809753',display_name='tempest-TestVolumeBackupRestore-server-1112809753',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebackuprestore-server-1112809753',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmIIVMyKvX+FfQwiNfRAJzQJYbY4u/xp4Lo/so2jCelpIHgFG6ALY6nbjvelBiTx36OuBPy6hmpI7z/kfZUyGjFLtO/Mp+l6eNOOAgUnwbTdQ3LD323svo65RFmqrfXvA==',key_name='tempest-TestVolumeBackupRestore-423350767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f78524b7a74be2affb10b0321431d8',ramdisk_id='',reservation_id='r-3btk0utw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-607996593',owner_user_name='tempest-TestVolumeBackupRestore-607996593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:18Z,user_data=None,user_id='53d325d0dba64ea3b96f96d326512846',uuid=d1b58792-6c38-4e10-8f6e-8382d97d9bbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converting VIF {"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:28.414071 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:16:28.414466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.414466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:28.414641 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:16:28.415252 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.415430 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '005305b8-2655-58cf-a5ad-e3d4b1350fd5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:28.416217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.416871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:28.418689 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.420185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.420339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap732dc8c0-32, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:28.420598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap732dc8c0-32, col_values=(('qos', UUID('c98a3c33-28c9-418d-b068-a319d85f5cee')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:28.420779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap732dc8c0-32, col_values=(('external_ids', {'iface-id': '732dc8c0-3256-493b-9052-13598ff9b65a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:88:b8', 'vm-uuid': 'd1b58792-6c38-4e10-8f6e-8382d97d9bbe'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:28.421532 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.422646 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:28.427150 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.427820 np0000000663 nova-compute[98103]: INFO os_vif [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32')
May 13 02:16:28.612933 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:28.702019 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a9ee7efd-d363-41ad-a193-fdc4eb1713b1 req-ed820ab3-ed8a-455f-8d57-47a24ca579e3 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Received event network-vif-deleted-059fb0c1-9865-4348-bf5f-8056dbe21fbf {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:28.702614 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-a9ee7efd-d363-41ad-a193-fdc4eb1713b1 req-ed820ab3-ed8a-455f-8d57-47a24ca579e3 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Neutron deleted interface 059fb0c1-9865-4348-bf5f-8056dbe21fbf; detaching it from the instance and deleting it from the info cache
May 13 02:16:28.702614 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a9ee7efd-d363-41ad-a193-fdc4eb1713b1 req-ed820ab3-ed8a-455f-8d57-47a24ca579e3 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:29.151106 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:29.208362 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a9ee7efd-d363-41ad-a193-fdc4eb1713b1 req-ed820ab3-ed8a-455f-8d57-47a24ca579e3 service nova] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Detach interface failed, port_id=059fb0c1-9865-4348-bf5f-8056dbe21fbf, reason: Instance 40182305-b217-4ea3-bb1a-09b673321381 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:16:29.652952 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Took 1.45 seconds to deallocate network for instance.
May 13 02:16:29.943748 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:29.943924 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:29.943962 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] No VIF found with MAC fa:16:3e:f4:88:b8, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:29.944308 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Using config drive
May 13 02:16:30.198053 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Took 0.54 seconds to detach 1 volumes for instance.
May 13 02:16:30.449470 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:30.579262 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Creating config drive at /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/disk.config
May 13 02:16:30.582670 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjfmvz0_q {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:30.655327 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjfmvz0_q" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:30.704910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:30.705182 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:30.803212 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:30.803441 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:30.961664 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:30.962210 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:31.089348 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.115054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.221570 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.278004 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d1cb1bb-4093-4eb0-bb1a-619b0e4aeb77 req-32d3d615-d354-46d5-9dd7-040f57dac79a service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:31.278201 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d1cb1bb-4093-4eb0-bb1a-619b0e4aeb77 req-32d3d615-d354-46d5-9dd7-040f57dac79a service nova] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:31.278397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d1cb1bb-4093-4eb0-bb1a-619b0e4aeb77 req-32d3d615-d354-46d5-9dd7-040f57dac79a service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:31.278542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d1cb1bb-4093-4eb0-bb1a-619b0e4aeb77 req-32d3d615-d354-46d5-9dd7-040f57dac79a service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:31.278967 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d1cb1bb-4093-4eb0-bb1a-619b0e4aeb77 req-32d3d615-d354-46d5-9dd7-040f57dac79a service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Processing event network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:16:31.306262 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:16:31.393673 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.395440 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.398329 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.399714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.424225 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:31.465018 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:31.863705 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:31.878464 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638591.87798, d1b58792-6c38-4e10-8f6e-8382d97d9bbe => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:31.879028 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:16:31.879249 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] VM Started (Lifecycle Event)
May 13 02:16:31.881433 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:16:31.883975 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance spawned successfully.
May 13 02:16:31.884661 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:16:31.973707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.268s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:31.975781 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.110s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:31.981586 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:16:31.981842 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Claim successful on node np0000000663
May 13 02:16:32.008486 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:32.009039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:32.034801 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 40182305-b217-4ea3-bb1a-09b673321381
May 13 02:16:32.384642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:32.388160 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:32.395246 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.395420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.395778 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.396027 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.396296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.396711 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:32.512626 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:32.892785 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:16:32.892785 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638592.8915699, d1b58792-6c38-4e10-8f6e-8382d97d9bbe => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:32.892785 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] VM Paused (Lifecycle Event)
May 13 02:16:32.905209 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Took 11.95 seconds to spawn the instance on the hypervisor.
May 13 02:16:32.905537 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:33.047504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-164293ef-2a7b-48c0-a3e1-1556041f0e61 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "40182305-b217-4ea3-bb1a-09b673321381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.989s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:33.195306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:33.195588 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:33.350446 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:33.350637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:33.350752 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:33.350857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:33.351558 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] No waiting events found dispatching network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:33.351689 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e31a2e28-c835-4993-bfae-06f638399924 req-a8fd1a0a-0ce0-48f4-abeb-5863bb710c40 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received unexpected event network-vif-plugged-732dc8c0-3256-493b-9052-13598ff9b65a for instance with vm_state active and task_state None.
May 13 02:16:33.398516 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:33.402063 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638593.40105, d1b58792-6c38-4e10-8f6e-8382d97d9bbe => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:33.402220 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] VM Resumed (Lifecycle Event)
May 13 02:16:33.412894 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Took 19.14 seconds to build instance.
May 13 02:16:33.433356 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:33.519875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:33.698236 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:33.907709 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:33.909542 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:33.914370 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.651s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:34.207832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.234s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:34.210982 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:16:34.593085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:34.593085 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:34.593319 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Attaching volume 22f08782-2549-4e0e-b5b4-937379759b6e to /dev/vdb
May 13 02:16:34.650533 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:34.664326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:16:34.695175 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:34.726438 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:16:34.726589 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:16:34.730396 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:34.730396 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:34.754731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:16:34.755028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:16:34.767419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:16:34.768269 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fef4:88b8', 'fe80::340e:27ff:fecb:4ca4'] 
May 13 02:16:34.771035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:16:34.771035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:16:34.771035 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:34.771035 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating existing volume attachment record: f65afa24-cacf-438c-9774-678d8e941a34 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:16:34.850553 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63c9dc09e45e4cdeb438d163532a8849', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf4cdaf6da19497586ec83765be014b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:16:35.047228 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:35.047228 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing instance network info cache due to event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:35.047228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:35.047228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:35.047228 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:35.235121 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:16:35.361121 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:16:35.361121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:35.361121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:35.363190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:35.363613 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:16:35.387844 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:35.387844 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:35.388105 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:35.389037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:35.389660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:35.390562 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:35.408991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:35.408991 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:35.418297 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Successfully created port: 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:16:35.423762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:35.423762 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:35.428226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e] added
May 13 02:16:35.428226 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:35.428226 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:35.428226 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:35.428226 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:35.428226 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:35.428226 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:35.428507 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:35.429501 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0386(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:35.429501 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:35.440331 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e] added
May 13 02:16:35.440331 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:35.440331 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:35.440331 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:35.440331 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:35.440331 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:35.440331 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:35.441111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:35.441111 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0527(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:35.441111 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:35.550448 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:35.739577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:16:35.889511 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:36.004953 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00045792400032951264 future=<Future at 0x705c6c190e60 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.005107 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.005268 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.008618202000434394 future=<Future at 0x705c6c2801a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.005416 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=0.008501384000282997 future=<Future at 0x705c6c2801a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.006621 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Emitting event <LifecycleEvent: 1778638581.0043669, 84dee6c9-e7c2-44ef-a37f-f4b8707326b7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:36.006955 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] VM Stopped (Lifecycle Event)
May 13 02:16:36.014253 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00032734099977460573 future=<Future at 0x705c6c2801a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.014327 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:16:36.014980 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] Emitting event <LifecycleEvent: 1778638581.013817, 40182305-b217-4ea3-bb1a-09b673321381 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:36.015163 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] VM Stopped (Lifecycle Event)
May 13 02:16:36.155401 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Successfully updated port: 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:16:36.164846 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:36.204838 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-changed-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:36.205020 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Refreshing instance network info cache due to event network-changed-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:36.205150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] Acquiring lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:36.205343 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] Acquired lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:36.205343 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Refreshing network info cache for port 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:36.299389 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updated VIF entry in instance network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:16:36.299642 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:36.429262 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:36.441607 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:36.443067 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:36.443067 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:36.460119 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:36.460119 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.465812 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.472501 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.479967 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.479967 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.479967 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:36.480318 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.480318 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.480318 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:36.487598 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.487598 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.487598 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:36.487819 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.487819 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.487819 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:36.509931 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0d982f92-6a2d-4d7c-af22-b6ef9e273d66 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: 84dee6c9-e7c2-44ef-a37f-f4b8707326b7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:36.513858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.50.100,3260]
May 13 02:16:36.513858 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.50.100,3260] successful.
May 13 02:16:36.513858 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.517777 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67278ea4-8562-4d1e-b44e-e06e8b98ef1e tempest-AttachVolumeTestJSON-1185409082 tempest-AttachVolumeTestJSON-1185409082-project-member] [instance: 40182305-b217-4ea3-bb1a-09b673321381] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:36.525580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.40.100,3260]
May 13 02:16:36.525580 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.40.100,3260] successful.
May 13 02:16:36.525580 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.529786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.540753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:36.552264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.552264 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.552264 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.552264 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.552264 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:36.552536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.552536 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.552536 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.552536 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.552536 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:36.552698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:36.552878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:36.553601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] HCTL ('7', '-', '-', 0) found on session 167 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:36.553840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:36.555146 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.555146 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.555146 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.555146 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.555146 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:36.555406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.555406 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:36.555406 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.555406 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:36.555406 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:36.555668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:36.555845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:36.556473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] HCTL ('8', '-', '-', 0) found on session 168 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:36.556588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:36.571158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching for a device in session 167 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:36.571158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:36.576870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching for a device in session 168 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:36.576870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:36.658862 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:36.707432 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:36.753235 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:16:36.754529 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:16:36.754865 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Creating image(s)
May 13 02:16:36.758792 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:36.758932 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:36.759533 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:36.760462 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:36.767371 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:36.768692 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:36.805507 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:36.811825 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d53259d5-d9c1-4017-81a9-d772af5dea7a req-ba6be5ec-ebef-41ca-80d4-18c9a480a952 service nova] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:36.872028 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.103s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:36.872663 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:36.873234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:36.873786 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:36.876634 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:36.877111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:36.966123 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:36.969858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:36.970515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:37.051303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk 1073741824" returned: 0 in 0.080s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:37.052036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:37.052519 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:37.108106 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:37.108320 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing instance network info cache due to event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:37.108608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:37.108763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:37.108953 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:37.162726 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:37.163236 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:16:37.163540 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:37.270899 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:37.271371 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Cannot resize image /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:16:37.271904 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:16:37.272148 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Ensure instance console log exists: /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:16:37.272485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:37.272683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:37.272936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:37.389820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:16:37.471421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6e9ceaab-f49e-4de6-b205-357ab3332a56 req-60887c79-3ac6-4ac9-9b3d-eb8440dda50b service nova] Releasing lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:37.472218 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquired lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:37.472388 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:16:37.618634 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:37.710106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:37.964142 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:38.064952 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:38.124980 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updated VIF entry in instance network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:16:38.125284 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:38.249435 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:38.373625 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating instance_info_cache with network_info: [{"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:38.411210 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found WWN 330000000947703e8 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:16:38.411280 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:38.411595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000947703e8', 'path': '/dev/dm-0', 'multipath_id': '330000000947703e8'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:38.411689 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000947703e8', 'path': '/dev/dm-0', 'multipath_id': '330000000947703e8'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:16:38.426305 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:38.435376 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:38.554974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:38.555207 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:38.632396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:38.632630 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:38.632779 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing instance network info cache due to event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:38.633026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:38.633196 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:38.633306 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:38.875568 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Releasing lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:38.875886 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance network_info: |[{"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:16:38.878458 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Start _get_guest_xml network_info=[{"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:16:38.881247 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:38.883111 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-664694500', uuid='5dd1c267-af4b-4892-b056-492f11daf856'), owner=OwnerMeta(userid='63c9dc09e45e4cdeb438d163532a8849', username='tempest-TestEncryptedCinderVolumes-1329189432-project-member', projectid='cf4cdaf6da19497586ec83765be014b7', projectname='tempest-TestEncryptedCinderVolumes-1329189432'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638598.882447) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:16:38.884163 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:16:38.884544 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:16:38.885607 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:16:38.886020 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:16:38.886902 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:16:38.887338 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:16:38.887523 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:16:38.887647 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:16:38.887820 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:16:38.887953 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:16:38.888073 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:16:38.888291 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:16:38.888418 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:16:38.888564 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:16:38.888695 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:16:38.888853 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:16:38.906729 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-664694500',display_name='tempest-TestEncryptedCinderVolumes-server-664694500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-664694500',id=64,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxwYkz9KeXOs+vWMmjn8/B4RLbdPO/1OUA3w0bHM9qjc7xrSSYKQz5LCEBKVE0UG5zDghU9ovZFm4Br/xi6QKRcn5t6Rqz+qt/Njzdc/XzhpluKZhdtN2egc07n26qVxA==',key_name='tempest-keypair-850596137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-p99on3n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=5dd1c267-af4b-4892-b056-492f11daf856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:16:38.906956 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:38.907743 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:38.908449 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:38.929465 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Attempting to attach volume 22f08782-2549-4e0e-b5b4-937379759b6e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:16:38.931200 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:   <alias name="ua-22f08782-2549-4e0e-b5b4-937379759b6e"/>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:   <serial>22f08782-2549-4e0e-b5b4-937379759b6e</serial>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:38.931200 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:16:39.057203 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:16:39.135983 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] End _get_guest_xml xml=<domain type="qemu">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <uuid>5dd1c267-af4b-4892-b056-492f11daf856</uuid>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <name>instance-00000040</name>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-664694500</nova:name>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:16:38</nova:creationTime>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:user uuid="63c9dc09e45e4cdeb438d163532a8849">tempest-TestEncryptedCinderVolumes-1329189432-project-member</nova:user>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:project uuid="cf4cdaf6da19497586ec83765be014b7">tempest-TestEncryptedCinderVolumes-1329189432</nova:project>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         <nova:port uuid="5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <system>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="serial">5dd1c267-af4b-4892-b056-492f11daf856</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="uuid">5dd1c267-af4b-4892-b056-492f11daf856</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </system>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <os>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </os>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <features>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </features>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   <devices>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.config"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:f1:d5:bc"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <target dev="tap5a6ccdfe-7e"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </interface>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/console.log" append="off"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </serial>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <video>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </video>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </rng>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:   </devices>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: </domain>
May 13 02:16:39.413140 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Preparing to wait for external event network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-664694500',display_name='tempest-TestEncryptedCinderVolumes-server-664694500',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-664694500',id=64,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxwYkz9KeXOs+vWMmjn8/B4RLbdPO/1OUA3w0bHM9qjc7xrSSYKQz5LCEBKVE0UG5zDghU9ovZFm4Br/xi6QKRcn5t6Rqz+qt/Njzdc/XzhpluKZhdtN2egc07n26qVxA==',key_name='tempest-keypair-850596137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-p99on3n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=5dd1c267-af4b-4892-b056-492f11daf856,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:16:39.413140 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:39.419403 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:39.419403 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:16:39.419403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.419403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:39.419758 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:16:39.420500 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.420690 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4083a031-1e81-5e92-b910-d0d08a62e385', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:39.430595 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.431343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:39.434693 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.434931 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a6ccdfe-7e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:39.435374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a6ccdfe-7e, col_values=(('qos', UUID('ee08b8d8-345a-41d9-9768-49e489bb50b3')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:39.435506 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a6ccdfe-7e, col_values=(('external_ids', {'iface-id': '5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:d5:bc', 'vm-uuid': '5dd1c267-af4b-4892-b056-492f11daf856'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:39.436663 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.437965 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:39.440427 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:39.442942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:39.444802 np0000000663 nova-compute[98103]: INFO os_vif [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e')
May 13 02:16:39.588981 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updated VIF entry in instance network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:16:39.588981 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:39.642211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:39.642211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:39.646312 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:16:39.646312 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Claim successful on node np0000000663
May 13 02:16:40.096767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d35019a6-5df9-4466-b717-85eb6cd470af req-119a15e0-f53b-44d0-8a97-77b207c56698 service nova] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:40.492482 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:40.600496 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:40.600638 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:40.600710 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:40.603110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No VIF found with MAC fa:16:3e:5e:bb:d0, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:40.890824 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:40.904230 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:40.904516 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:40.969987 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:40.969987 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:40.969987 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:f1:d5:bc, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:40.969987 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Using config drive
May 13 02:16:41.407179 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:41.484592 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:41.643886 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Creating config drive at /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.config
May 13 02:16:41.651873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptc8l9zwl {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:41.710710 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptc8l9zwl" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:41.914959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:41.915472 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:16:42.153414 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3624ed1b-cf58-49cf-a4f7-873abb8f85ff tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.560s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:42.205252 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.241002 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.331818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.422519 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:16:42.423568 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:16:42.423568 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:42.423568 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:42.522075 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:16:42.535764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9b67fd89-0b4f-4419-ac6e-1509ae5585cb req-784ca3b7-7dae-4ebf-80b7-bcab78c15901 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:42.535836 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9b67fd89-0b4f-4419-ac6e-1509ae5585cb req-784ca3b7-7dae-4ebf-80b7-bcab78c15901 service nova] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:42.536068 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9b67fd89-0b4f-4419-ac6e-1509ae5585cb req-784ca3b7-7dae-4ebf-80b7-bcab78c15901 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:42.536397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9b67fd89-0b4f-4419-ac6e-1509ae5585cb req-784ca3b7-7dae-4ebf-80b7-bcab78c15901 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:42.536397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9b67fd89-0b4f-4419-ac6e-1509ae5585cb req-784ca3b7-7dae-4ebf-80b7-bcab78c15901 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Processing event network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:16:42.573805 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.578654 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.586112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.615137 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:42.927808 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:16:43.167336 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Successfully created port: 9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:16:43.262179 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:16:43.263071 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638603.2627192, 5dd1c267-af4b-4892-b056-492f11daf856 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:43.263313 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] VM Started (Lifecycle Event)
May 13 02:16:43.268573 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:16:43.272345 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance spawned successfully.
May 13 02:16:43.272843 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:16:43.434065 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:16:43.649777 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:43.770775 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:43.778807 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:43.788704 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.788704 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.788704 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.788944 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.789550 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.789550 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:43.836933 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Successfully updated port: 9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:16:43.942365 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Booting with volume snapshot 35ee0948-ad04-4fc2-bdb6-d8e5327c4d08 at /dev/vda
May 13 02:16:44.284820 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:16:44.285080 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638604.2849112, 5dd1c267-af4b-4892-b056-492f11daf856 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:44.285223 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] VM Paused (Lifecycle Event)
May 13 02:16:44.294227 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Took 7.54 seconds to spawn the instance on the hypervisor.
May 13 02:16:44.294442 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:44.346966 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:44.347077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:44.347219 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:16:44.436595 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] No waiting events found dispatching network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received unexpected event network-vif-plugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 for instance with vm_state active and task_state None.
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-changed-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Refreshing instance network info cache due to event network-changed-9428b4c2-da77-4928-b541-ef674a396313. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:44.616249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Acquiring lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:44.788191 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:44.795365 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638604.7950277, 5dd1c267-af4b-4892-b056-492f11daf856 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:44.795556 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] VM Resumed (Lifecycle Event)
May 13 02:16:44.817583 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Took 13.00 seconds to build instance.
May 13 02:16:44.958581 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:45.172496 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:45.297816 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:45.300403 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:45.320225 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.517s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:45.322443 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Updating instance_info_cache with network_info: [{"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:45.498763 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:45.825104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:45.825543 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Instance network_info: |[{"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:16:45.826136 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Acquired lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:45.826424 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Refreshing network info cache for port 9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:45.892561 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:46.328386 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:46.411644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-changed-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:46.411795 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Refreshing instance network info cache due to event network-changed-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:46.411944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] Acquiring lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:46.412024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] Acquired lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:46.412163 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Refreshing network info cache for port 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:46.473198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:46.473384 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:46.755133 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:46.916290 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Updated VIF entry in instance network info cache for port 9428b4c2-da77-4928-b541-ef674a396313. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:16:46.916805 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Updating instance_info_cache with network_info: [{"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:46.917701 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:46.975898 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Detaching volume 22f08782-2549-4e0e-b5b4-937379759b6e
May 13 02:16:47.037280 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Attempting to driver detach volume 22f08782-2549-4e0e-b5b4-937379759b6e from mountpoint /dev/vdb
May 13 02:16:47.041639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found disk vdb by alias ua-22f08782-2549-4e0e-b5b4-937379759b6e {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:16:47.042926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found disk vdb by alias ua-22f08782-2549-4e0e-b5b4-937379759b6e {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:16:47.043048 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Attempting to detach device vdb from instance 3fe8732c-63d4-4c50-950b-791d81d36975 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:16:47.044337 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <alias name="ua-22f08782-2549-4e0e-b5b4-937379759b6e"/>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <serial>22f08782-2549-4e0e-b5b4-937379759b6e</serial>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:47.044337 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:16:47.053056 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully detached device vdb from instance 3fe8732c-63d4-4c50-950b-791d81d36975 from the persistent domain config.
May 13 02:16:47.053179 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] (1/8): Attempting to detach device vdb with device alias ua-22f08782-2549-4e0e-b5b4-937379759b6e from instance 3fe8732c-63d4-4c50-950b-791d81d36975 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:16:47.053389 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <alias name="ua-22f08782-2549-4e0e-b5b4-937379759b6e"/>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <serial>22f08782-2549-4e0e-b5b4-937379759b6e</serial>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]: </disk>
May 13 02:16:47.053389 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:16:47.300216 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:47.425705 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2d25ab4a-11d3-49de-80c5-b6c1ea744929 req-ff763de1-5698-457d-ac0f-7df2e2eacaf9 service nova] Releasing lock "refresh_cache-f946641e-0bf2-425c-af72-d2b8316b2f75" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:47.481934 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updated VIF entry in instance network info cache for port 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:16:47.482214 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating instance_info_cache with network_info: [{"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:47.488663 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:47.501567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:16:47.533538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:47.584427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638607.5833752, 3fe8732c-63d4-4c50-950b-791d81d36975 => ua-22f08782-2549-4e0e-b5b4-937379759b6e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:16:47.585251 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-22f08782-2549-4e0e-b5b4-937379759b6e for instance 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:16:47.589910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:16:47.590861 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:16:47.594265 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully detached device vdb from instance 3fe8732c-63d4-4c50-950b-791d81d36975 from the live domain config.
May 13 02:16:47.596122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:16:47.596627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:47.596815 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:47.597380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:47.597754 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '22f08782-2549-4e0e-b5b4-937379759b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:16:47.597938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:16:47.604137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:16:47.608126 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fef4:88b8', 'fe80::340e:27ff:fecb:4ca4', 'fe80::fc16:3eff:fef1:d5bc', 'fe80::429:8eff:fe11:1b52'] 
May 13 02:16:47.608268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:16:47.608461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:16:47.608774 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:47.609085 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Updating existing volume attachment record: 190fc9e7-5961-4a4c-b8fc-a45d1b126ba3 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e (non-flash)
May 13 02:16:47.631422 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', '168')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', '168')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:47.631422 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e', '167')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:16:47.631862 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c801d02c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'): ({'sdb'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:16:47.631862 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:16:47.631986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flush multipath device 330000000947703e8 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:16:47.670543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:47.722073 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:16:47.775895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:16:47.776265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:16:47.777532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:16:47.793372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:16:47.793372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:16:47.809042 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.842873 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.40.100,3260]
May 13 02:16:47.842873 np0000000663 nova-compute[98103]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.40.100,3260] successful.
May 13 02:16:47.842873 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.857258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.870061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.897518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.50.100,3260]
May 13 02:16:47.897518 np0000000663 nova-compute[98103]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-22f08782-2549-4e0e-b5b4-937379759b6e, portal: 192.168.50.100,3260] successful.
May 13 02:16:47.897518 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.914837 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:47.915115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:47.915196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== disconnect_volume: return (318ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:47.915322 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:16:47.990062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd5d906a-801b-4603-bbdf-d0c1d4d1883f req-0967337e-b947-4128-b497-e6593b068ad6 service nova] Releasing lock "refresh_cache-5dd1c267-af4b-4892-b056-492f11daf856" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:48.475018 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:49.439605 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:49.481519 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e0e3a02-228b-4da0-ba49-45fc00e4743f tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.008s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:49.515348 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:49.515509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:49.743331 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:16:49.744415 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:16:49.744695 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Creating image(s)
May 13 02:16:49.744935 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:16:49.745056 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Ensure instance console log exists: /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:16:49.745321 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:49.745463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:49.745655 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:49.746133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Start _get_guest_xml network_info=[{"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f946641e-0bf2-425c-af72-d2b8316b2f75', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'serial': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e'}, 'attachment_id': '190fc9e7-5961-4a4c-b8fc-a45d1b126ba3', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:16:49.749443 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:49.750631 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-282772917', uuid='f946641e-0bf2-425c-af72-d2b8316b2f75'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638609.7503028) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:16:49.752152 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:16:49.752448 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:16:49.753482 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:16:49.753623 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:16:49.754516 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:16:49.754817 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:16:49.756521 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:16:49.757024 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:16:49.766827 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:16:49.767081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:16:49.767219 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:49.767492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:49.767985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:16:49.780205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:49.781230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:16:49.782012 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:49.782838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:16:49.783239 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:49.783521 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:49.795528 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:49.795528 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:49.800961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:16:49.800961 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:49.808555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e] added
May 13 02:16:49.808555 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:49.808555 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:49.808555 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:49.808555 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:49.808555 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:49.808555 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:49.808802 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:49.808925 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:49.809063 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:49.813262 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e] added
May 13 02:16:49.813262 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:16:49.813262 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:49.813262 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:49.813262 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:16:49.813262 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:16:49.813262 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:49.813490 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:16:49.813571 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:16:49.813742 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:16:50.017269 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:16:50.577999 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:50.578505 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:50.581484 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:16:50.581638 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Claim successful on node np0000000663
May 13 02:16:50.809474 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:16:50.815491 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:50.829518 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:50.829518 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:16:50.837373 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:16:50.837373 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.846799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.852802 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.865607 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.865607 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.865607 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:50.865860 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.865860 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.865860 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:50.875382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.875382 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.875382 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:50.875382 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.875382 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.875382 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:50.894333 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:50.904709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.40.100,3260]
May 13 02:16:50.904709 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.40.100,3260] successful.
May 13 02:16:50.904709 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.916884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.924630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.50.100,3260]
May 13 02:16:50.924630 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.50.100,3260] successful.
May 13 02:16:50.924630 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.936968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.936968 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.936968 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.936968 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.936968 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:50.937298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.937298 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.937298 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.937298 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.937298 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:50.938340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:16:50.938724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:50.940514 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:50.941470 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('7', '-', '-', 0) found on session 171 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:50.941603 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:50.953848 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.953848 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.953848 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.953848 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.953848 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:16:50.953990 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.953990 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:16:50.953990 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.953990 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:16:50.953990 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:16:50.954252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:50.954361 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:16:50.956451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 172 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:16:50.956451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:16:50.959223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 171 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:50.959441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:50.970894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 172 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:16:50.971129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:16:51.781980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:16:51.830834 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:16:51.832017 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:16:51.927823 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:52.336152 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:16:52.437012 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] instance snapshotting
May 13 02:16:52.552393 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Beginning live snapshot process
May 13 02:16:52.796440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 33000000089bd8523 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:16:52.796899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:16:52.796899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '33000000089bd8523', 'path': '/dev/dm-0', 'multipath_id': '33000000089bd8523'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:16:52.796982 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000089bd8523', 'path': '/dev/dm-0', 'multipath_id': '33000000089bd8523'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:16:52.843151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.263s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:52.843151 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:16:53.302604 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-282772917',display_name='tempest-TestVolumeBootPattern-server-282772917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-282772917',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-2f7ehy6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:43Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=f946641e-0bf2-425c-af72-d2b8316b2f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:16:53.302868 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:53.303615 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:53.304503 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid f946641e-0bf2-425c-af72-d2b8316b2f75 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:53.349398 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:16:53.350020 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:16:53.350319 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:53.350539 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:53.414252 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4acc4ee8597744baa14224320669fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3847aeaf9841b199e63d3c1c099c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:16:53.807954 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] End _get_guest_xml xml=<domain type="qemu">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <uuid>f946641e-0bf2-425c-af72-d2b8316b2f75</uuid>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <name>instance-00000041</name>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-282772917</nova:name>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:16:49</nova:creationTime>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         <nova:port uuid="9428b4c2-da77-4928-b541-ef674a396313">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <system>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="serial">f946641e-0bf2-425c-af72-d2b8316b2f75</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="uuid">f946641e-0bf2-425c-af72-d2b8316b2f75</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </system>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <os>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </os>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <features>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </features>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   <devices>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/disk.config"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <alias name="ua-ad86d0e4-4854-4ca9-bf79-1beb47d3053e"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <serial>ad86d0e4-4854-4ca9-bf79-1beb47d3053e</serial>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:e7:47:72"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <target dev="tap9428b4c2-da"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </interface>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/console.log" append="off"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </serial>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <video>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </video>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </rng>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:   </devices>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]: </domain>
May 13 02:16:53.807954 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:16:53.810613 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Preparing to wait for external event network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:16:53.810613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:53.810613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:53.810613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:53.810613 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-282772917',display_name='tempest-TestVolumeBootPattern-server-282772917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-282772917',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-2f7ehy6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:43Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=f946641e-0bf2-425c-af72-d2b8316b2f75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:16:53.812994 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:53.813939 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:53.814388 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:16:53.814635 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.819277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:53.821301 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:16:53.822429 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.823021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56ca5872-feaa-59ac-957b-792144fceb36', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:53.826798 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.827379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:53.832354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.832354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9428b4c2-da, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:53.832354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9428b4c2-da, col_values=(('qos', UUID('46edde78-3db9-44fd-b95c-59a81a2e2a94')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:53.832354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9428b4c2-da, col_values=(('external_ids', {'iface-id': '9428b4c2-da77-4928-b541-ef674a396313', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:47:72', 'vm-uuid': 'f946641e-0bf2-425c-af72-d2b8316b2f75'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:53.833590 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.838856 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:53.846374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:53.847701 np0000000663 nova-compute[98103]: INFO os_vif [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da')
May 13 02:16:53.852334 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:16:53.940003 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Successfully created port: 346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:16:54.070119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:54.174284 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json -f qcow2" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:54.178153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json -f qcow2 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:54.267364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json -f qcow2" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:54.276812 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:54.280346 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:54.280952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:54.358838 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:16:54.388801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:54.392115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528.delta 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:54.463272 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528.delta 1073741824" returned: 0 in 0.072s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:54.463272 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Quiescing instance not available: QEMU guest agent is not enabled.
May 13 02:16:54.511255 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Successfully updated port: 346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:16:54.560152 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:54.560498 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing instance network info cache due to event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:16:54.560785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] Acquiring lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:54.560815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] Acquired lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:54.560951 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing network info cache for port 346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:16:54.748375 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:16:55.013854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:16:55.063145 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:55.134726 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:55.254158 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98103) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 13 02:16:55.257021 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Skipping quiescing instance: QEMU guest agent is not enabled.
May 13 02:16:55.277468 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:55.302123 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:16:55.302438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528.delta /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.373499 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:16:55.374709 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:16:55.374969 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Creating image(s)
May 13 02:16:55.376009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:55.376388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:55.377280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:55.378147 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:55.379271 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:55.381783 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:55.382150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:55.382150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:e7:47:72, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:55.382150 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Using config drive
May 13 02:16:55.384855 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.500950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.116s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.503322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:55.503824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:55.504246 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:55.506919 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:16:55.507268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.553918 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528.delta /opt/stack/data/nova/instances/snapshots/tmpkl1vejq4/f0a78fa0efd64e63ad7bd6deb6cfa528" returned: 0 in 0.251s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.558561 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Snapshot extracted, beginning image upload
May 13 02:16:55.612857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.613211 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.674582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk 1073741824" returned: 0 in 0.061s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.675158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.171s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:55.675597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.775504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.776001 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:16:55.776346 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:55.794504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-23626566-f2f2-443b-bf80-4dca12fc5aa1 req-0cb6da52-ae83-4bbd-beeb-7307ad441a7b service nova] Releasing lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:55.795823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquired lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:16:55.796150 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:16:55.884577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:55.884962 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Cannot resize image /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:16:55.885312 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:16:55.885518 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Ensure instance console log exists: /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:16:55.885820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:55.886045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:55.886328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:55.897828 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:55.910124 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:56.062025 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Creating config drive at /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/disk.config
May 13 02:16:56.070322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp97xxpo30 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:16:56.129209 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp97xxpo30" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:16:56.381064 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:16:56.569470 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:16:56.579268 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.613014 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.614835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.734938 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.802708 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:16:56.859038 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d328c177-b557-400b-9aae-26ac8681cae3 req-539377c5-55d2-44f5-9705-a38b55e6d213 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:56.859300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d328c177-b557-400b-9aae-26ac8681cae3 req-539377c5-55d2-44f5-9705-a38b55e6d213 service nova] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:56.859544 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d328c177-b557-400b-9aae-26ac8681cae3 req-539377c5-55d2-44f5-9705-a38b55e6d213 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:56.859727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d328c177-b557-400b-9aae-26ac8681cae3 req-539377c5-55d2-44f5-9705-a38b55e6d213 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:56.859860 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d328c177-b557-400b-9aae-26ac8681cae3 req-539377c5-55d2-44f5-9705-a38b55e6d213 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Processing event network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:16:56.958201 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.961628 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.963902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:56.994887 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.307476 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Releasing lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:16:57.308036 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance network_info: |[{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:16:57.311327 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Start _get_guest_xml network_info=[{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:16:57.317703 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:16:57.319325 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-160403114', uuid='c19374b4-2270-4a5d-ba5c-251d9c52797e'), owner=OwnerMeta(userid='4acc4ee8597744baa14224320669fc51', username='tempest-VolumeMultiattachTests-932012962-project-member', projectid='7a3847aeaf9841b199e63d3c1c099c9f', projectname='tempest-VolumeMultiattachTests-932012962'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638617.3188605) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:16:57.321981 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:16:57.322434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:16:57.324832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:16:57.326511 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:16:57.327716 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:16:57.328140 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:16:57.328323 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:16:57.328458 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:16:57.329298 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:16:57.329298 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:16:57.330206 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:16:57.330589 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:16:57.330751 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:16:57.330891 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:16:57.331020 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:16:57.331194 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:16:57.349746 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-160403114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-160403114',id=66,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-8tdn6vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=c19374b4-2270-4a5d-ba5c-251d9c52797e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:16:57.350070 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:57.351168 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:57.351376 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'pci_devices' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:16:57.459875 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.637394 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638617.6367857, f946641e-0bf2-425c-af72-d2b8316b2f75 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:57.638112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:16:57.639008 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] VM Started (Lifecycle Event)
May 13 02:16:57.641876 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:16:57.645740 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Instance spawned successfully.
May 13 02:16:57.646244 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:16:57.864614 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] End _get_guest_xml xml=<domain type="qemu">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <uuid>c19374b4-2270-4a5d-ba5c-251d9c52797e</uuid>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <name>instance-00000042</name>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumeMultiattachTests-server-160403114</nova:name>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:16:57</nova:creationTime>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:user uuid="4acc4ee8597744baa14224320669fc51">tempest-VolumeMultiattachTests-932012962-project-member</nova:user>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:project uuid="7a3847aeaf9841b199e63d3c1c099c9f">tempest-VolumeMultiattachTests-932012962</nova:project>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         <nova:port uuid="346253e0-41cf-475d-82d3-9052880cc0c2">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <system>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="serial">c19374b4-2270-4a5d-ba5c-251d9c52797e</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="uuid">c19374b4-2270-4a5d-ba5c-251d9c52797e</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </system>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <os>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </os>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <features>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </features>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   <devices>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.config"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </disk>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:c2:a8:78"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <target dev="tap346253e0-41"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </interface>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/console.log" append="off"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </serial>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <video>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </video>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </rng>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:   </devices>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]: </domain>
May 13 02:16:57.864614 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Preparing to wait for external event network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-160403114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-160403114',id=66,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-8tdn6vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=c19374b4-2270-4a5d-ba5c-251d9c52797e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:16:57.867469 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:16:57.868680 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:16:57.868966 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:16:57.869396 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.869717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:57.870003 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:16:57.872311 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.872521 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a730517-13f4-5fed-b5d2-d24638cf96dc', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:57.873459 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.874138 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:57.874872 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.878946 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.879161 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap346253e0-41, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:57.879584 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap346253e0-41, col_values=(('qos', UUID('e63936ef-b376-4092-9a0c-d33267d5ec9c')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:57.879826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap346253e0-41, col_values=(('external_ids', {'iface-id': '346253e0-41cf-475d-82d3-9052880cc0c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:a8:78', 'vm-uuid': 'c19374b4-2270-4a5d-ba5c-251d9c52797e'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:16:57.880765 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.886074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:16:57.887949 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:57.889398 np0000000663 nova-compute[98103]: INFO os_vif [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41')
May 13 02:16:58.146859 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:58.152759 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:58.158903 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.159083 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.159454 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.159679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.159941 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.160196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:16:58.507784 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Snapshot image upload complete
May 13 02:16:58.508207 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-14ebeb34-1d10-4301-ba40-e62e17adc8c2 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Took 6.07 seconds to snapshot the instance on the hypervisor.
May 13 02:16:58.654952 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:16:58.655233 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638618.6550226, f946641e-0bf2-425c-af72-d2b8316b2f75 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:58.655360 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] VM Paused (Lifecycle Event)
May 13 02:16:58.664701 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Took 8.92 seconds to spawn the instance on the hypervisor.
May 13 02:16:58.664845 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:58.922109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:16:58.922253 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:16:58.922494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:16:58.922494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:58.922698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] No waiting events found dispatching network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:16:58.922810 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7bc1ffc3-1ec2-4e1d-906c-e8d0c318d4f2 req-67564f19-6bbc-485d-9a80-94d96362113a service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received unexpected event network-vif-plugged-9428b4c2-da77-4928-b541-ef674a396313 for instance with vm_state active and task_state None.
May 13 02:16:58.983193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:16:59.157745 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:59.163469 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638619.1632326, f946641e-0bf2-425c-af72-d2b8316b2f75 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:16:59.163784 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] VM Resumed (Lifecycle Event)
May 13 02:16:59.176015 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Took 19.61 seconds to build instance.
May 13 02:16:59.414928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:59.415014 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:16:59.415146 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:c2:a8:78, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:16:59.415580 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Using config drive
May 13 02:16:59.667490 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:16:59.674703 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:16:59.678742 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.123s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:16:59.921879 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:00.083054 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Creating config drive at /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.config
May 13 02:17:00.087538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7dfo25_p {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:00.151613 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7dfo25_p" returned: 0 in 0.064s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:00.641486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:00.670760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:00.776451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:00.873053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:00.873053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:00.900170 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.038263 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2cbee21a-2414-40f2-9d23-505b17483775 req-167213f4-db62-42c7-b4ac-f50e80291ea5 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:01.039299 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2cbee21a-2414-40f2-9d23-505b17483775 req-167213f4-db62-42c7-b4ac-f50e80291ea5 service nova] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:01.039481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2cbee21a-2414-40f2-9d23-505b17483775 req-167213f4-db62-42c7-b4ac-f50e80291ea5 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:01.039660 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2cbee21a-2414-40f2-9d23-505b17483775 req-167213f4-db62-42c7-b4ac-f50e80291ea5 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:01.039916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2cbee21a-2414-40f2-9d23-505b17483775 req-167213f4-db62-42c7-b4ac-f50e80291ea5 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Processing event network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:17:01.070374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.072954 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.076065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.107057 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.201077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:01.201277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:01.201449 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:01.201589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:01.201749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:01.204363 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Terminating instance
May 13 02:17:01.375050 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:17:01.612468 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638621.611937, c19374b4-2270-4a5d-ba5c-251d9c52797e => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:01.614323 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] VM Started (Lifecycle Event)
May 13 02:17:01.616698 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:17:01.620182 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:17:01.627389 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance spawned successfully.
May 13 02:17:01.628889 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:17:01.710285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:17:01.730042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.733913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.763177 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.800434 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:01.969870 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:01.970080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:01.977450 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:17:01.977450 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Claim successful on node np0000000663
May 13 02:17:02.062425 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Instance destroyed successfully.
May 13 02:17:02.063173 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid f946641e-0bf2-425c-af72-d2b8316b2f75 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:02.119117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:02.127155 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:02.145717 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.145904 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.146382 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.146706 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.147058 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.147391 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:02.566256 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:16:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-282772917',display_name='tempest-TestVolumeBootPattern-server-282772917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-282772917',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:16:58Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-2f7ehy6f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:59Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=f946641e-0bf2-425c-af72-d2b8316b2f75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:17:02.567062 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "9428b4c2-da77-4928-b541-ef674a396313", "address": "fa:16:3e:e7:47:72", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9428b4c2-da", "ovs_interfaceid": "9428b4c2-da77-4928-b541-ef674a396313", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:02.567727 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:02.567951 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:17:02.740809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.744084 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Took 7.37 seconds to spawn the instance on the hypervisor.
May 13 02:17:02.754478 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:02.755706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:02.756861 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638622.755773, c19374b4-2270-4a5d-ba5c-251d9c52797e => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:02.757058 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] VM Paused (Lifecycle Event)
May 13 02:17:02.758352 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.758562 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9428b4c2-da, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:02.761939 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.763042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:02.763581 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.763723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46edde78-3db9-44fd-b95c-59a81a2e2a94) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:02.764205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.764679 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:02.765504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:02.772050 np0000000663 nova-compute[98103]: INFO os_vif [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:47:72,bridge_name='br-int',has_traffic_filtering=True,id=9428b4c2-da77-4928-b541-ef674a396313,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9428b4c2-da')
May 13 02:17:02.773978 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:17:02.774377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:02.774607 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:02.775304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:02.775741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:17:02.775952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:17:02.807427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:02.807427 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:02.807427 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:17:02.807427 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:17:02.807427 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:02.807657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:02.807657 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:02.807657 np0000000663 nova-compute[98103]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:17:02.807657 np0000000663 nova-compute[98103]: tcp: [172] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e (non-flash)
May 13 02:17:02.807657 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:02.807789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', '171'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', '172')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:17:02.807849 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', '171')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:02.809444 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e', '172')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:02.810211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c486562a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:17:02.810461 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:17:02.810991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 33000000089bd8523 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:17:02.858116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:02.903855 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:02.950715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:17:02.950910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:17:02.951884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:17:02.965858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:17:02.966144 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:17:02.979521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.012868 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.40.100,3260]
May 13 02:17:03.012868 np0000000663 nova-compute[98103]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.40.100,3260] successful.
May 13 02:17:03.012868 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.029577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.040975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.072553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.50.100,3260]
May 13 02:17:03.072553 np0000000663 nova-compute[98103]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-ad86d0e4-4854-4ca9-bf79-1beb47d3053e, portal: 192.168.50.100,3260] successful.
May 13 02:17:03.072553 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.098306 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:03.098562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:03.098706 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (324ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:03.098848 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:17:03.099153 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Deleting instance files /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75_del
May 13 02:17:03.099863 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Deletion of /opt/stack/data/nova/instances/f946641e-0bf2-425c-af72-d2b8316b2f75_del complete
May 13 02:17:03.161041 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:03.161354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:03.161490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:03.161656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:03.161928 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] No waiting events found dispatching network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:03.162059 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received unexpected event network-vif-plugged-346253e0-41cf-475d-82d3-9052880cc0c2 for instance with vm_state active and task_state None.
May 13 02:17:03.162240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:03.162340 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:03.162524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:03.163420 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:03.163420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] No waiting events found dispatching network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:03.163420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:03.163420 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:03.166280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Acquiring lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:03.166280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:03.166280 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:03.166280 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] No waiting events found dispatching network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:03.166280 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-65860499-c03f-4ff9-b2ea-3adcaaf89816 req-211db46f-1af8-4931-803b-428eb3d3e878 service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-unplugged-9428b4c2-da77-4928-b541-ef674a396313 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:03.264395 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:03.269121 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638623.2687926, c19374b4-2270-4a5d-ba5c-251d9c52797e => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:03.269302 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] VM Resumed (Lifecycle Event)
May 13 02:17:03.277602 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Took 12.75 seconds to build instance.
May 13 02:17:03.379202 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:03.379445 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:03.616141 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Took 1.90 seconds to destroy the instance on the hypervisor.
May 13 02:17:03.616141 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:17:03.616141 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:17:03.616141 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:17:03.616365 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:03.703081 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:03.777334 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:03.778521 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:03.779366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.264s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:03.885120 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:04.278559 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:04.284399 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999645611999767 future=<Future at 0x705c6c695160 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:04.286079 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997949489999883 future=<Future at 0x705c6c695160 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:04.286267 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.997736433999762 future=<Future at 0x705c6c695160 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:04.311980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:04.312194 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing instance network info cache due to event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:04.312423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] Acquiring lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:04.312513 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] Acquired lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:04.314339 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing network info cache for port 346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:04.390134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.419s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:04.390134 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:17:04.592854 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:04.816433 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:04.896724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:17:04.896919 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:17:04.897215 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:04.897438 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:04.993759 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86981c5164f4476893f3937fe22f5a40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b5475f08f0a44c4a95ec0ce67c5f366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:17:05.095543 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Took 1.48 seconds to deallocate network for instance.
May 13 02:17:05.199432 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:05.265401 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7dfe2cc5-931b-4f60-90fa-5a091973d96c req-2596bb03-b7b0-4171-bda7-710effd33c8d service nova] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Received event network-vif-deleted-9428b4c2-da77-4928-b541-ef674a396313 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:05.320299 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updated VIF entry in instance network info cache for port 346253e0-41cf-475d-82d3-9052880cc0c2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:17:05.320632 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:05.401118 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:17:05.469120 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Successfully created port: 397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:17:05.641848 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Took 0.55 seconds to detach 1 volumes for instance.
May 13 02:17:05.643674 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Deleting volume: ad86d0e4-4854-4ca9-bf79-1beb47d3053e {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:17:05.822854 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33af6dae-5350-435e-808a-abad890c00d8 req-a4011edd-2ab3-4963-863f-2c75a739dc23 service nova] Releasing lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:05.900868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:05.906615 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:17:06.016104 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Successfully updated port: 397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:17:06.187923 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:06.188248 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:06.393854 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-changed-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:06.394085 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing instance network info cache due to event network-changed-397043a4-0f01-45fb-b47e-188546902296. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:06.394278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] Acquiring lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:06.394372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] Acquired lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:06.394477 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing network info cache for port 397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:06.518271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:06.537397 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:06.537610 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:06.896775 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:06.920233 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:17:06.921053 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:17:06.921281 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Creating image(s)
May 13 02:17:06.921839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:06.922077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:06.927784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:06.928132 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:06.928464 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:06.984240 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:07.041033 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:07.180637 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:07.549448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.361s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:07.621570 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance f946641e-0bf2-425c-af72-d2b8316b2f75
May 13 02:17:07.684626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17381b79-c183-4b01-8301-25d8ba9f7e6a req-6aaa475f-293a-4b18-a9ec-f135f2238bb6 service nova] Releasing lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:07.684626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquired lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:07.684626 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:17:07.764552 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:07.896016 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:07.899634 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:07.900107 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.023853 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.part --force-share --output=json" returned: 0 in 0.123s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.024436 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] 6d9ea03e-2be7-4b06-8757-b9f6303d00ab was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:17:08.025056 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:17:08.025328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.part /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.225557 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.part /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.converted" returned: 0 in 0.200s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.243933 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:08.246784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.364328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd.converted --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.365076 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.436s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:08.365716 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:08.370943 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:08.372652 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.446509 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:08.460516 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:08.460738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:08.461191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:08.461305 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:08.461433 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] No waiting events found dispatching network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:08.461561 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e16a5b76-c793-4985-b842-abfbad2ec82e req-8fb8c21a-e607-4a7e-8931-eb342d04abfd service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received unexpected event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 for instance with vm_state building and task_state spawning.
May 13 02:17:08.500438 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json" returned: 0 in 0.128s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.500812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:08.501215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:08.501664 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:08.504803 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:08.505152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.603823 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:08.610204 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.610698 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd,backing_fmt=raw /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.651808 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a1979aa4-bbf4-441b-b130-5fcb6ea50aaf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "f946641e-0bf2-425c-af72-d2b8316b2f75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.450s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:08.694844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd,backing_fmt=raw /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk 1073741824" returned: 0 in 0.084s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.695332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:08.695794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:08.797481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ea10d247cdd0271eaa2d6dc3ccb47a58f3a1ebd --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:08.798315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:17:08.798612 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Ensure instance console log exists: /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:17:08.798991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:08.799320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:08.799536 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:09.107372 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Releasing lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:09.107972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance network_info: |[{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:17:09.110420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Start _get_guest_xml network_info=[{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='25d8081f66606f08e04308d16aba7f7b',container_format='bare',created_at=2026-05-13T02:16:51Z,direct_url=<?>,disk_format='qcow2',id=6d9ea03e-2be7-4b06-8757-b9f6303d00ab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1069030662',owner='9b5475f08f0a44c4a95ec0ce67c5f366',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-13T02:16:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '6d9ea03e-2be7-4b06-8757-b9f6303d00ab'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:17:09.115151 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:17:09.116565 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1972435748', uuid='1451f9e6-0d3b-423d-9475-eef08937c6fb'), owner=OwnerMeta(userid='86981c5164f4476893f3937fe22f5a40', username='tempest-TestStampPattern-185105098-project-member', projectid='9b5475f08f0a44c4a95ec0ce67c5f366', projectname='tempest-TestStampPattern-185105098'), image=ImageMeta(id='6d9ea03e-2be7-4b06-8757-b9f6303d00ab', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '9b5475f08f0a44c4a95ec0ce67c5f366'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638629.116222) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:17:09.117869 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:17:09.118213 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:17:09.119376 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:17:09.119540 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:17:09.120535 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:17:09.120839 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='25d8081f66606f08e04308d16aba7f7b',container_format='bare',created_at=2026-05-13T02:16:51Z,direct_url=<?>,disk_format='qcow2',id=6d9ea03e-2be7-4b06-8757-b9f6303d00ab,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1069030662',owner='9b5475f08f0a44c4a95ec0ce67c5f366',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-13T02:16:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:17:09.120971 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:17:09.121075 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:17:09.121236 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:17:09.121325 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:17:09.121409 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:17:09.121551 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:17:09.121652 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:17:09.121763 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:17:09.121850 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:17:09.121954 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:17:09.134109 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1972435748',display_name='tempest-TestStampPattern-server-1972435748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1972435748',id=67,image_ref='6d9ea03e-2be7-4b06-8757-b9f6303d00ab',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-i8ccyx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3fe8732c-63d4-4c50-950b-791d81d36975',image_min_disk='1',image_min_ram='0',image_owner_id='9b5475f08f0a44c4a95ec0ce67c5f366',image_owner_project_name='tempest-TestStampPattern-185105098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-185105098-project-member',image_user_id='86981c5164f4476893f3937fe22f5a40',network_allocated='True',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:06Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=1451f9e6-0d3b-423d-9475-eef08937c6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:17:09.134303 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:09.134954 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:09.135569 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'pci_devices' on Instance uuid 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:09.592738 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:17:09.595111 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:17:09.638908 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] End _get_guest_xml xml=<domain type="qemu">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <uuid>1451f9e6-0d3b-423d-9475-eef08937c6fb</uuid>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <name>instance-00000043</name>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestStampPattern-server-1972435748</nova:name>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:17:09</nova:creationTime>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:property name="img_owner_id">9b5475f08f0a44c4a95ec0ce67c5f366</nova:property>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:user uuid="86981c5164f4476893f3937fe22f5a40">tempest-TestStampPattern-185105098-project-member</nova:user>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:project uuid="9b5475f08f0a44c4a95ec0ce67c5f366">tempest-TestStampPattern-185105098</nova:project>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         <nova:port uuid="397043a4-0f01-45fb-b47e-188546902296">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <system>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="serial">1451f9e6-0d3b-423d-9475-eef08937c6fb</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="uuid">1451f9e6-0d3b-423d-9475-eef08937c6fb</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </system>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <os>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </os>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <features>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </features>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   <devices>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.config"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:b2:95:45"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <target dev="tap397043a4-0f"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </interface>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/console.log" append="off"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </serial>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <video>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </video>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </rng>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:   </devices>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]: </domain>
May 13 02:17:09.638908 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Preparing to wait for external event network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1972435748',display_name='tempest-TestStampPattern-server-1972435748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1972435748',id=67,image_ref='6d9ea03e-2be7-4b06-8757-b9f6303d00ab',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-i8ccyx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3fe8732c-63d4-4c50-950b-791d81d36975',image_min_disk='1',image_min_ram='0',image_owner_id='9b5475f08f0a44c4a95ec0ce67c5f366',image_owner_project_name='tempest-TestStampPattern-185105098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-185105098-project-member',image_user_id='86981c5164f4476893f3937fe22f5a40',network_allocated='True',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:06Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=1451f9e6-0d3b-423d-9475-eef08937c6fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:17:09.641864 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:09.642365 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:09.642659 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:17:09.643210 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.643666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:09.644053 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:17:09.645067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.645296 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3db3b61-cde5-5e36-8e28-eb57ff35d1b0', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:09.646065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.648492 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:09.650175 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.650346 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397043a4-0f, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:09.650749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap397043a4-0f, col_values=(('qos', UUID('c4374505-1a7f-4b11-a9a5-acf24d72425d')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:09.650937 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap397043a4-0f, col_values=(('external_ids', {'iface-id': '397043a4-0f01-45fb-b47e-188546902296', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:95:45', 'vm-uuid': '1451f9e6-0d3b-423d-9475-eef08937c6fb'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:09.652340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.653365 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:09.657040 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:09.658315 np0000000663 nova-compute[98103]: INFO os_vif [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f')
May 13 02:17:10.099768 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:10.099975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:10.100126 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:10.100253 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:17:10.906359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:11.059575 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:11.060089 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing instance network info cache due to event network-changed-732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:11.060334 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] Acquiring lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:11.060487 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] Acquired lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:11.060705 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Refreshing network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:11.133275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.183037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:11.183257 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:11.183503 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No VIF found with MAC fa:16:3e:b2:95:45, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:17:11.184781 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Using config drive
May 13 02:17:11.235326 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.235741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.322820 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.327324 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.419293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.419743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.536765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.541061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.564977 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:11.569619 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:11.570078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:11.570435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:11.570649 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:11.571074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:11.576660 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Terminating instance
May 13 02:17:11.653913 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.654304 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.697712 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:11.774120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.774608 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Periodic task is updating the host stat, it is trying to get disk instance-00000043, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.config'
May 13 02:17:11.784463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.883122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:11.883122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.937894 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Creating config drive at /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.config
May 13 02:17:11.947039 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobdw8n9l {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:11.994680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:12.009395 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:17:12.011757 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:17:12.013075 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:12.038883 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpobdw8n9l" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:12.041188 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:12.071285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:12.073116 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12730MB free_disk=72.71859741210938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:17:12.073116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:12.073116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:12.081540 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:17:12.115598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.125599 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.148448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.151195 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.187051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.188131 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.268924 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updated VIF entry in instance network info cache for port 732dc8c0-3256-493b-9052-13598ff9b65a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:17:12.269839 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [{"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:12.311804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:12.314730 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:12.314971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:12.315157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:12.315308 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] No waiting events found dispatching network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:12.315435 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9ebb8409-e09f-44d5-b388-d06097c58602 req-7840682f-b4e1-4dad-8880-fd6b78f31264 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:12.543743 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.555555 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.660320 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999673131000236 future=<Future at 0x705c8831cc50 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:12.671548 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Instance destroyed successfully.
May 13 02:17:12.672669 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lazy-loading 'resources' on Instance uuid d1b58792-6c38-4e10-8f6e-8382d97d9bbe {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:12.678760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.724713 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.772255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-20d05e73-8adf-41c0-91d4-2cf3bda7309c req-12cee3e4-27be-4919-b832-ca1269908aba service nova] Releasing lock "refresh_cache-d1b58792-6c38-4e10-8f6e-8382d97d9bbe" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:12.802740 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.819260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.826726 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:12.890951 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ac40b5a1-2e3b-4d6a-a8f3-121639b6e34e req-fb9dc648-2339-4293-993c-9bd663f6bf88 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:12.895531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ac40b5a1-2e3b-4d6a-a8f3-121639b6e34e req-fb9dc648-2339-4293-993c-9bd663f6bf88 service nova] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:12.895531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ac40b5a1-2e3b-4d6a-a8f3-121639b6e34e req-fb9dc648-2339-4293-993c-9bd663f6bf88 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:12.895531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ac40b5a1-2e3b-4d6a-a8f3-121639b6e34e req-fb9dc648-2339-4293-993c-9bd663f6bf88 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:12.895531 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ac40b5a1-2e3b-4d6a-a8f3-121639b6e34e req-fb9dc648-2339-4293-993c-9bd663f6bf88 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Processing event network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:17:13.138056 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 3fe8732c-63d4-4c50-950b-791d81d36975 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:17:13.138430 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance d1b58792-6c38-4e10-8f6e-8382d97d9bbe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:17:13.138430 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5dd1c267-af4b-4892-b056-492f11daf856 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:17:13.138430 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance c19374b4-2270-4a5d-ba5c-251d9c52797e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:17:13.138430 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1451f9e6-0d3b-423d-9475-eef08937c6fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:17:13.138616 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:17:13.138767 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:17:12 up 41 min,  2 users,  load average: 6.13, 7.13, 5.31\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '5', 'num_proj_9b5475f08f0a44c4a95ec0ce67c5f366': '2', 'io_workload': '1', 'num_task_deleting': '1', 'num_proj_05f78524b7a74be2affb10b0321431d8': '1', 'num_proj_cf4cdaf6da19497586ec83765be014b7': '1', 'num_proj_7a3847aeaf9841b199e63d3c1c099c9f': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:17:13.176989 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:16:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1112809753',display_name='tempest-TestVolumeBackupRestore-server-1112809753',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebackuprestore-server-1112809753',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmIIVMyKvX+FfQwiNfRAJzQJYbY4u/xp4Lo/so2jCelpIHgFG6ALY6nbjvelBiTx36OuBPy6hmpI7z/kfZUyGjFLtO/Mp+l6eNOOAgUnwbTdQ3LD323svo65RFmqrfXvA==',key_name='tempest-TestVolumeBackupRestore-423350767',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:16:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f78524b7a74be2affb10b0321431d8',ramdisk_id='',reservation_id='r-3btk0utw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-607996593',owner_user_name='tempest-TestVolumeBackupRestore-607996593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:33Z,user_data=None,user_id='53d325d0dba64ea3b96f96d326512846',uuid=d1b58792-6c38-4e10-8f6e-8382d97d9bbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:17:13.176989 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converting VIF {"id": "732dc8c0-3256-493b-9052-13598ff9b65a", "address": "fa:16:3e:f4:88:b8", "network": {"id": "6eaf1a2e-353d-4d57-b5be-7be979641124", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1717149614-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f78524b7a74be2affb10b0321431d8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap732dc8c0-32", "ovs_interfaceid": "732dc8c0-3256-493b-9052-13598ff9b65a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:13.176989 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:13.177451 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:17:13.179740 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:13.179960 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap732dc8c0-32, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:13.181129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c98a3c33-28c9-418d-b068-a319d85f5cee) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:13.185277 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:13.186538 np0000000663 nova-compute[98103]: INFO os_vif [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:88:b8,bridge_name='br-int',has_traffic_filtering=True,id=732dc8c0-3256-493b-9052-13598ff9b65a,network=Network(6eaf1a2e-353d-4d57-b5be-7be979641124),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732dc8c0-32')
May 13 02:17:13.188639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:17:13.189051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:13.189171 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:13.190083 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:13.194098 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:17:13.194253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:17:13.226394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:13.226394 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:13.226394 np0000000663 nova-compute[98103]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:17:13.226394 np0000000663 nova-compute[98103]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:17:13.226394 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:13.226842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:13.226842 np0000000663 nova-compute[98103]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d (non-flash)
May 13 02:17:13.226842 np0000000663 nova-compute[98103]: tcp: [173] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:17:13.226842 np0000000663 nova-compute[98103]: tcp: [174] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:17:13.226842 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:13.226842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '173'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '174')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:17:13.227138 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '165')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:13.227902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d', '166')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:13.228562 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c70ba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:17:13.229059 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Removing multipathed devices sdg, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:17:13.229544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Flush multipath device 3300000005a0394d6 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:17:13.288315 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:13.336688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:13.378141 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:17:13.378325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:17:13.379384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:17:13.396968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:17:13.397518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:17:13.415038 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.449861 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.40.100,3260]
May 13 02:17:13.449861 np0000000663 nova-compute[98103]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.40.100,3260] successful.
May 13 02:17:13.449861 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.470248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.485663 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:13.485941 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:13.487340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.516158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.50.100,3260]
May 13 02:17:13.516158 np0000000663 nova-compute[98103]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-659a8bdf-b47f-4597-a4f8-a6f7f032fb0d, portal: 192.168.50.100,3260] successful.
May 13 02:17:13.516158 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.531901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:13.532300 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:13.532546 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] <== disconnect_volume: return (343ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:13.532639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:17:13.532928 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Deleting instance files /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe_del
May 13 02:17:13.533470 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Deletion of /opt/stack/data/nova/instances/d1b58792-6c38-4e10-8f6e-8382d97d9bbe_del complete
May 13 02:17:13.651647 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638633.6499627, 1451f9e6-0d3b-423d-9475-eef08937c6fb => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:13.651647 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] VM Started (Lifecycle Event)
May 13 02:17:13.651977 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:17:13.655599 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:17:13.659710 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance spawned successfully.
May 13 02:17:13.659710 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:17:13.663292 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:13.663832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:13.989951 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:14.041508 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Took 1.96 seconds to destroy the instance on the hypervisor.
May 13 02:17:14.042297 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:17:14.042635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:17:14.042769 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:17:14.043002 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:14.106107 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:14.153399 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:14.157028 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:14.169871 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Took 7.25 seconds to spawn the instance on the hypervisor.
May 13 02:17:14.169871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] Acquiring lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] No waiting events found dispatching network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:14.378591 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b51d9e70-70bc-4b4f-8b3c-fd869b5246e7 req-ed63897b-3c7d-46a1-8a0e-b66f9413e2e2 service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-unplugged-732dc8c0-3256-493b-9052-13598ff9b65a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:14.496808 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:17:14.496958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.425s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:14.497308 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.28 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:17:14.663893 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:14.664203 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638634.663997, 1451f9e6-0d3b-423d-9475-eef08937c6fb => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:14.664346 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] VM Paused (Lifecycle Event)
May 13 02:17:14.686127 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Took 12.80 seconds to build instance.
May 13 02:17:14.886300 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:15.020177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:15.020649 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:15.020819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:15.021287 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:15.021287 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] No waiting events found dispatching network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:15.021287 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-4a7eeb2f-0bc9-4325-ad15-67a55fece19f req-1a6d6c9d-0030-409a-b798-2d362e2956aa service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received unexpected event network-vif-plugged-397043a4-0f01-45fb-b47e-188546902296 for instance with vm_state active and task_state None.
May 13 02:17:15.166852 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:15.170958 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638635.170661, 1451f9e6-0d3b-423d-9475-eef08937c6fb => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:15.171154 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] VM Resumed (Lifecycle Event)
May 13 02:17:15.187845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fd5ba22e-1d89-4346-98bb-cfc4c20ccd3d tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.315s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:15.389991 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Took 1.35 seconds to deallocate network for instance.
May 13 02:17:15.542570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:15.542810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:15.673794 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:15.679984 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:15.903457 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:15.950741 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:17:16.048635 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:17:16.289073 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-changed-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:16.289528 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing instance network info cache due to event network-changed-397043a4-0f01-45fb-b47e-188546902296. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:16.289657 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] Acquiring lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:16.289757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] Acquired lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:16.289858 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing network info cache for port 397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:16.431068 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9103e869-1531-40da-a34b-d453b02c44e1 req-2988b42a-75f4-48f1-b71f-5cd06405b20d service nova] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Received event network-vif-deleted-732dc8c0-3256-493b-9052-13598ff9b65a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:16.456460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:16.456627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:16.608761 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:16.792172 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:16.804364 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:16.804549 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:17.134795 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:17.268515 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updated VIF entry in instance network info cache for port 397043a4-0f01-45fb-b47e-188546902296. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:17:17.268816 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:17.307653 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:17.773033 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1a3ada5-df05-4233-b2a5-f666010b12e6 req-29a735b2-d719-4252-ab1c-15736765b851 service nova] Releasing lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:17.780316 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:17.780462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:17.815896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.359s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:17.817687 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.208s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:17.821235 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:17:17.821235 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Claim successful on node np0000000663
May 13 02:17:17.866191 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Deleted allocations for instance d1b58792-6c38-4e10-8f6e-8382d97d9bbe
May 13 02:17:18.191065 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:18.282799 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:17:18.853276 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:18.875400 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0fb1ab66-04a4-485f-8cf6-a58f0014f800 tempest-TestVolumeBackupRestore-607996593 tempest-TestVolumeBackupRestore-607996593-project-member] Lock "d1b58792-6c38-4e10-8f6e-8382d97d9bbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.305s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:19.105838 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:19.106052 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:19.285023 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0007674540001971764 future=<Future at 0x705c6c695160 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:19.285296 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:19.285296 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.374647775000085 future=<Future at 0x705c8831cc50 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:19.285385 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.374556024999947 future=<Future at 0x705c8831cc50 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:19.286690 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Emitting event <LifecycleEvent: 1778638624.283938, f946641e-0bf2-425c-af72-d2b8316b2f75 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:19.286690 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] VM Stopped (Lifecycle Event)
May 13 02:17:19.608627 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:19.788203 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-72980878-feba-467b-b9ab-c5e9cbb3136f tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: f946641e-0bf2-425c-af72-d2b8316b2f75] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:20.119817 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.303s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:20.119817 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:17:20.123061 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.270s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:20.133712 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:17:20.134012 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Claim successful on node np0000000663
May 13 02:17:20.626848 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:17:20.627009 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:17:20.627265 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:20.627478 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:20.730018 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:17:20.915217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:21.131230 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:17:21.170938 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Successfully created port: 567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:17:21.448814 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:21.448969 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:21.635648 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:17:21.655424 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Successfully updated port: 567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:17:21.719623 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-changed-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:21.720029 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Refreshing instance network info cache due to event network-changed-567b24a4-b872-4efc-bd7d-f283a0d19f27. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:21.720216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] Acquiring lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:21.720354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] Acquired lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:21.720481 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Refreshing network info cache for port 567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:21.951363 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:22.140375 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Booting with volume 371ff342-90e2-461b-b139-b7b9cd40f294 at /dev/vda
May 13 02:17:22.157776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:22.188452 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:22.200998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:17:22.221030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:22.234771 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:22.264560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:17:22.265397 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:17:22.267395 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:22.273437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:17:22.274771 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fef1:d5bc', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:feb2:9545'] 
May 13 02:17:22.275870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:17:22.275870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:17:22.276042 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:22.276254 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating existing volume attachment record: 211b10c3-df7e-4f20-8b62-e91ffb2dc9aa {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:17:22.331438 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:22.460812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.338s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:22.461896 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:17:22.486325 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:22.691340 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:22.691531 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:22.969607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:17:22.969904 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:17:22.970263 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:22.970623 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:22.988219 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-58d786e1-f8ea-47f9-bcbc-61d32a72ea14 req-dec6dbd4-e030-4aa3-84f0-a91812572898 service nova] Releasing lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:22.988637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:22.988776 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:17:23.042809 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c20465c49104552b6af116f9e0c14d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfe4c819c84128b0149ebe05ecf5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:17:23.192528 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:23.196475 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:23.472497 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:17:23.558843 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Successfully created port: f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:17:23.561425 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:23.734599 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:23.870689 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating instance_info_cache with network_info: [{"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:23.951520 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:23.975385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:17:24.082868 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Successfully updated port: f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:17:24.135267 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-changed-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:24.135418 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Refreshing instance network info cache due to event network-changed-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:24.135585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] Acquiring lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:24.135715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] Acquired lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:24.135879 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Refreshing network info cache for port f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:24.203547 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:24.379463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:24.379753 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance network_info: |[{"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:17:24.398210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:17:24.398951 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:17:24.399212 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Creating image(s)
May 13 02:17:24.399463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:17:24.399609 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Ensure instance console log exists: /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:17:24.399812 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:24.399952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:24.400059 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:24.400695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Start _get_guest_xml network_info=[{"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '4c853575-60b7-45b0-9260-7d33471ac9d7', 'attached_at': '', 'detached_at': '', 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'serial': '371ff342-90e2-461b-b139-b7b9cd40f294'}, 'attachment_id': '211b10c3-df7e-4f20-8b62-e91ffb2dc9aa', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:17:24.404914 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:17:24.406004 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1493970762', uuid='4c853575-60b7-45b0-9260-7d33471ac9d7'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638644.4057102) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:17:24.407391 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:17:24.407698 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:17:24.408420 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:17:24.408695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:17:24.409586 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:17:24.409823 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:17:24.409991 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:17:24.410165 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:17:24.410328 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:17:24.410452 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:17:24.410596 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:17:24.410807 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:17:24.410939 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:17:24.411131 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:17:24.411323 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:17:24.411414 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:17:24.420950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:17:24.421291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:24.421737 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:24.421873 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:24.422088 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:17:24.435895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:24.436353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:24.436554 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:24.437058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:24.437573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:24.437841 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:24.448384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:24.448384 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:24.452618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:24.452618 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294] added
May 13 02:17:24.460964 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:24.460964 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:24.460964 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:24.464451 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294] added
May 13 02:17:24.464451 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:24.464451 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:24.464451 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:24.464451 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:24.464451 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:24.464451 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:24.464972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:24.465166 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:24.465313 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:24.583982 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:24.638284 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:24.710284 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:24.892298 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:24.982126 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:17:24.983410 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:17:24.983860 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Creating image(s)
May 13 02:17:24.984433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:24.984650 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:24.985184 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:24.985714 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:24.988446 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:24.989704 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.101320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.111s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:25.101811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:25.102315 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:25.102775 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:25.105276 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:17:25.105672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.198373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:25.198851 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.260771 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk 1073741824" returned: 0 in 0.062s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:25.261342 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:25.261575 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.306457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:25.306915 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:25.307010 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Attaching volume d82d0e71-4d61-4068-9b11-16930335db8e to /dev/vdb
May 13 02:17:25.345024 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:25.358255 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:17:25.358347 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.097s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:25.360736 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:17:25.360736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.386412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:25.403868 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-98991015-3c87-4597-9216-8d81a8b1de7e req-74cfb68d-ae1c-4391-87fc-935cf5d3b229 service nova] Releasing lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:25.404926 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquired lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:25.405252 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:17:25.430919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:17:25.431155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:17:25.441194 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:17:25.442254 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fef1:d5bc', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:feb2:9545'] 
May 13 02:17:25.442399 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:17:25.442456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:17:25.442710 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:25.442929 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating existing volume attachment record: c4f7c497-e608-4e5a-914c-a87982c1412a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:17:25.455454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:25.455773 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Cannot resize image /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:17:25.456084 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:17:25.456274 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Ensure instance console log exists: /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:17:25.456556 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:25.456732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:25.456885 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:25.461296 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:25.465909 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:25.473670 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:25.473670 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:25.480313 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:25.480313 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:25.485765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:25.492941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:25.498455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:17:25.498455 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:25.498646 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:17:25.498646 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:25.498710 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:17:25.498710 np0000000663 nova-compute[98103]: 
May 13 02:17:25.505734 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:17:25.505734 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:25.505925 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:17:25.505925 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:25.506085 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:17:25.506085 np0000000663 nova-compute[98103]: 
May 13 02:17:25.917740 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:25.975172 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:17:26.033503 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5dd1c267-af4b-4892-b056-492f11daf856', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'serial': 'd82d0e71-4d61-4068-9b11-16930335db8e'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:17:26.036958 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:17:26.037338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:26.037513 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:26.138991 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:26.265038 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating instance_info_cache with network_info: [{"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:26.550633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.50.100,3260]
May 13 02:17:26.550633 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.50.100,3260] successful.
May 13 02:17:26.550633 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:26.550633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.40.100,3260]
May 13 02:17:26.550633 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.40.100,3260] successful.
May 13 02:17:26.550633 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:26.567204 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:26.576317 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:26.583589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.583589 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.583589 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:26.583847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.583847 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.583847 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:26.583987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.148s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:26.584090 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:26.584572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('7', '-', '-', 0) found on session 175 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:26.584677 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:26.590223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.590223 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.590223 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:26.590387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.590387 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:26.590387 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:26.590609 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.153s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:26.590707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:26.591159 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 176 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:26.591261 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:26.599731 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 175 and hctl ['7', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:26.615004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 176 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:26.615004 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:26.767054 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Releasing lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:26.767373 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance network_info: |[{"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:17:26.770724 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Start _get_guest_xml network_info=[{"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:17:26.776950 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:17:26.778263 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1926886913', uuid='11f800e0-bd37-43d5-af19-094d2f69e137'), owner=OwnerMeta(userid='7c20465c49104552b6af116f9e0c14d5', username='tempest-TestEncryptedCinderVolumes-368552408-project-member', projectid='57dfe4c819c84128b0149ebe05ecf5be', projectname='tempest-TestEncryptedCinderVolumes-368552408'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638646.777858) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:17:26.780751 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:17:26.781634 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:17:26.785960 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:17:26.785960 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:17:26.788425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:17:26.788776 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:17:26.788992 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:17:26.789177 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:17:26.789290 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:17:26.789408 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:17:26.789542 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:17:26.789733 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:17:26.789860 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:17:26.790039 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:17:26.790195 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:17:26.790349 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:17:26.805937 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1926886913',display_name='tempest-TestEncryptedCinderVolumes-server-1926886913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1926886913',id=69,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv6lyE8RBf32LlcLfnk1g98yuEnDJJzl84j5plOuXkSdpUXDqd7n7c7DrNG83uBDe2ymt0zGzX/pctFManWJm/FAgw2cHHN75afpRXEBkAxn+5RqJzfUtZ5Vjm8weAb8A==',key_name='tempest-keypair-881113935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-c99w3mx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c20465c49104552b6af116f9e0c14d5',uuid=11f800e0-bd37-43d5-af19-094d2f69e137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:17:26.806215 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:26.806915 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:26.807606 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'pci_devices' on Instance uuid 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:27.311159 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] End _get_guest_xml xml=<domain type="qemu">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <uuid>11f800e0-bd37-43d5-af19-094d2f69e137</uuid>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <name>instance-00000045</name>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1926886913</nova:name>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:17:26</nova:creationTime>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:user uuid="7c20465c49104552b6af116f9e0c14d5">tempest-TestEncryptedCinderVolumes-368552408-project-member</nova:user>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:project uuid="57dfe4c819c84128b0149ebe05ecf5be">tempest-TestEncryptedCinderVolumes-368552408</nova:project>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         <nova:port uuid="f4d53f75-7660-4f0f-a50b-ccf1c69bd38d">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <system>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="serial">11f800e0-bd37-43d5-af19-094d2f69e137</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="uuid">11f800e0-bd37-43d5-af19-094d2f69e137</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </system>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <os>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </os>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <features>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </features>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   <devices>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.config"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:0b:d1:89"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <target dev="tapf4d53f75-76"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </interface>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/console.log" append="off"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </serial>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <video>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </video>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </rng>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:   </devices>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]: </domain>
May 13 02:17:27.311159 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Preparing to wait for external event network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1926886913',display_name='tempest-TestEncryptedCinderVolumes-server-1926886913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1926886913',id=69,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv6lyE8RBf32LlcLfnk1g98yuEnDJJzl84j5plOuXkSdpUXDqd7n7c7DrNG83uBDe2ymt0zGzX/pctFManWJm/FAgw2cHHN75afpRXEBkAxn+5RqJzfUtZ5Vjm8weAb8A==',key_name='tempest-keypair-881113935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-c99w3mx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c20465c49104552b6af116f9e0c14d5',uuid=11f800e0-bd37-43d5-af19-094d2f69e137,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:17:27.313399 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:27.313744 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:27.314042 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:17:27.315336 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.316362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:27.316891 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:17:27.317809 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.317869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96e2069c-9732-5ad8-b6ee-bdddfc7c87a9', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:27.318686 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.319241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:27.319857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.322468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.322863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d53f75-76, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:27.322944 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4d53f75-76, col_values=(('qos', UUID('ea53cd6d-c19d-4296-a194-aee6ca3ff24b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:27.323069 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4d53f75-76, col_values=(('external_ids', {'iface-id': 'f4d53f75-7660-4f0f-a50b-ccf1c69bd38d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:d1:89', 'vm-uuid': '11f800e0-bd37-43d5-af19-094d2f69e137'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:27.323845 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.325989 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:27.330721 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:27.331805 np0000000663 nova-compute[98103]: INFO os_vif [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76')
May 13 02:17:27.600060 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 175 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:27.600400 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:27.665530 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.001490818000092986 future=<Future at 0x705c8831cc50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:27.665530 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:27.666655 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638632.6598709, d1b58792-6c38-4e10-8f6e-8382d97d9bbe => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:27.666775 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] VM Stopped (Lifecycle Event)
May 13 02:17:27.727185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:28.171017 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: d1b58792-6c38-4e10-8f6e-8382d97d9bbe] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:28.459587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 3300000004e487e90 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:17:28.460113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:28.460218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '3300000004e487e90', 'path': '/dev/dm-0', 'multipath_id': '3300000004e487e90'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:28.460562 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004e487e90', 'path': '/dev/dm-0', 'multipath_id': '3300000004e487e90'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:17:28.460930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.423s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:28.461252 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:17:28.476368 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:28.477369 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:28.477901 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:28.478134 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:28.479153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:28.479153 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:28.493264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:28.493264 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:28.498024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:28.498024 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:28.506899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e] added
May 13 02:17:28.506899 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:28.506899 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:28.506899 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:28.506899 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:28.506899 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:28.506899 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:28.507180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:28.507653 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:28.507653 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:28.513028 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e] added
May 13 02:17:28.513028 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:28.513028 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:28.513028 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:28.513028 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:28.513028 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:28.513028 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:28.513248 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:28.513535 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0344(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:28.513535 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:28.856915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:28.857075 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:28.857725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No VIF found with MAC fa:16:3e:0b:d1:89, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:17:28.857725 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Using config drive
May 13 02:17:28.972190 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-volume-backed-server-1493970762',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi8KGigeNhUbko1i6HkEgUQVrQyUMpI2WYm24j3BL9UxK8aM0sUeVN3LoWxkzdCw9gSc+yAWWHR1Mws8bbjMkoB7m4tH7nLhUXRvJu6pHYUiZE/qRq8P0sna0fkC72pGA==',key_name='tempest-keypair-1211053988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-oobv83wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=4c853575-60b7-45b0-9260-7d33471ac9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:17:28.972190 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:28.972190 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:28.972654 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c853575-60b7-45b0-9260-7d33471ac9d7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:29.364955 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:29.395711 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.427255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.476952 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] End _get_guest_xml xml=<domain type="qemu">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <uuid>4c853575-60b7-45b0-9260-7d33471ac9d7</uuid>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <name>instance-00000044</name>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1493970762</nova:name>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:17:24</nova:creationTime>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         <nova:port uuid="567b24a4-b872-4efc-bd7d-f283a0d19f27">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <system>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="serial">4c853575-60b7-45b0-9260-7d33471ac9d7</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="uuid">4c853575-60b7-45b0-9260-7d33471ac9d7</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </system>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <os>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </os>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <features>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </features>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   <devices>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/disk.config"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <alias name="ua-371ff342-90e2-461b-b139-b7b9cd40f294"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <serial>371ff342-90e2-461b-b139-b7b9cd40f294</serial>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </disk>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:e8:ee:e7"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <target dev="tap567b24a4-b8"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </interface>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/console.log" append="off"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </serial>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <video>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </video>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </rng>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:   </devices>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]: </domain>
May 13 02:17:29.476952 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Preparing to wait for external event network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-volume-backed-server-1493970762',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi8KGigeNhUbko1i6HkEgUQVrQyUMpI2WYm24j3BL9UxK8aM0sUeVN3LoWxkzdCw9gSc+yAWWHR1Mws8bbjMkoB7m4tH7nLhUXRvJu6pHYUiZE/qRq8P0sna0fkC72pGA==',key_name='tempest-keypair-1211053988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-oobv83wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=4c853575-60b7-45b0-9260-7d33471ac9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:29.480250 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:17:29.481023 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.481249 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:29.481411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:17:29.483076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.483259 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3e242e8-e94f-5e68-b3c2-02fccaad0404', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:29.483915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.485893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:29.491368 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.493595 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.493793 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap567b24a4-b8, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:29.494206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap567b24a4-b8, col_values=(('qos', UUID('8fee9c32-1565-41a3-8f6a-d4f5e6878fef')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:29.494402 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap567b24a4-b8, col_values=(('external_ids', {'iface-id': '567b24a4-b872-4efc-bd7d-f283a0d19f27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ee:e7', 'vm-uuid': '4c853575-60b7-45b0-9260-7d33471ac9d7'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:29.495332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.497190 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:29.505640 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:29.507372 np0000000663 nova-compute[98103]: INFO os_vif [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8')
May 13 02:17:29.507983 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:29.516464 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:29.525116 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:29.525116 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.534696 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Creating config drive at /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.config
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:29.536070 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:29.536070 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.543352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.544794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cz96h05 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:29.561120 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.562081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.562081 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.562081 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:29.562709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.562709 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.562709 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:29.574544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.574544 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.574544 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:29.574780 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.574780 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.574780 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:29.597797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.40.100,3260]
May 13 02:17:29.597797 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.40.100,3260] successful.
May 13 02:17:29.597797 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.611737 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.612681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cz96h05" returned: 0 in 0.068s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:29.621427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.50.100,3260]
May 13 02:17:29.621427 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.50.100,3260] successful.
May 13 02:17:29.621427 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.629773 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('9', '-', '-', 0) found on session 177 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:29.629773 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:29.636491 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:29.649492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 177 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:29.649492 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:29.652981 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] HCTL ('10', '-', '-', 0) found on session 178 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:29.652981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:29.672174 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Searching for a device in session 178 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:29.672567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:30.086344 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.132624 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.222728 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.410660 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.419384 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.422063 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.452067 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.458373 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:30.480056 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:17:30.908609 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638650.908214, 11f800e0-bd37-43d5-af19-094d2f69e137 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:30.909184 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] VM Started (Lifecycle Event)
May 13 02:17:30.935371 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:31.037293 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:31.037406 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:31.037524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:e8:ee:e7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:17:31.038025 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Using config drive
May 13 02:17:31.412448 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:31.415983 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638651.4149942, 11f800e0-bd37-43d5-af19-094d2f69e137 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:31.416243 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] VM Paused (Lifecycle Event)
May 13 02:17:31.497643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found WWN 33000000028db47e9 for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:17:31.498548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:31.500640 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== connect_volume: return (5461ms) {'type': 'block', 'scsi_wwn': '33000000028db47e9', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '33000000028db47e9'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:31.500640 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000028db47e9', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '33000000028db47e9'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:17:31.502635 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:17:31.503068 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:17:31.503481 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:17:31.504265 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x705c881718b0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '5dd1c267-af4b-4892-b056-492f11daf856', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'serial': 'd82d0e71-4d61-4068-9b11-16930335db8e'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:17:31.504611 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98103) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 13 02:17:31.504853 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] opening encrypted volume /dev/dm-3 {{(pid=98103) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 02:17:31.535800 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.luks [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 02:17:31.535800 np0000000663 nova-compute[98103]: INFO os_brick.encryptors.luks [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] /dev/dm-3 is not a valid LUKS device; formatting device for first use
May 13 02:17:31.535800 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98103) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 02:17:31.547827 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:31.664041 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Creating config drive at /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/disk.config
May 13 02:17:31.668171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi82vlhb9 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:31.725889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi82vlhb9" returned: 0 in 0.057s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:17:31.919119 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:31.921761 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:32.126265 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.167401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.167401 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.246719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.421076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.424469 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.424755 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:32.425120 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.426138 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:32.449779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:33.116250 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638653.1158857, 4c853575-60b7-45b0-9260-7d33471ac9d7 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:33.116719 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] VM Started (Lifecycle Event)
May 13 02:17:33.620201 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:33.633987 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638653.6336343, 4c853575-60b7-45b0-9260-7d33471ac9d7 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:33.634201 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] VM Paused (Lifecycle Event)
May 13 02:17:34.136825 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:34.139140 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:34.497666 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:34.641658 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:35.624510 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d0df486d-33f1-4ece-9515-9a178312d05d req-36c52b68-62bd-454b-b9b2-8d76c25be66a service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:35.624510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0df486d-33f1-4ece-9515-9a178312d05d req-36c52b68-62bd-454b-b9b2-8d76c25be66a service nova] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:35.624510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0df486d-33f1-4ece-9515-9a178312d05d req-36c52b68-62bd-454b-b9b2-8d76c25be66a service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:35.624510 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d0df486d-33f1-4ece-9515-9a178312d05d req-36c52b68-62bd-454b-b9b2-8d76c25be66a service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:35.624510 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d0df486d-33f1-4ece-9515-9a178312d05d req-36c52b68-62bd-454b-b9b2-8d76c25be66a service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Processing event network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:17:35.633696 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:17:35.653351 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:17:35.653942 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638655.6536853, 11f800e0-bd37-43d5-af19-094d2f69e137 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:35.654119 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] VM Resumed (Lifecycle Event)
May 13 02:17:35.661858 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance spawned successfully.
May 13 02:17:35.661858 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:17:35.952593 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:36.158522 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:36.161054 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:36.168617 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.168617 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.169000 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.169300 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.169658 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.169998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:36.663756 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:36.675108 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Took 11.69 seconds to spawn the instance on the hypervisor.
May 13 02:17:36.675342 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:37.190313 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Took 18.40 seconds to build instance.
May 13 02:17:37.687663 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:37.688026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:37.688026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:37.688086 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:37.688182 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] No waiting events found dispatching network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:37.688288 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received unexpected event network-vif-plugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d for instance with vm_state active and task_state None.
May 13 02:17:37.688382 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:37.688496 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:37.688615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:37.688723 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:37.688822 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Processing event network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:17:37.688932 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:37.689032 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:37.689169 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:37.689265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:37.689359 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] No waiting events found dispatching network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:37.689463 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-8788f357-4e13-4f2a-8209-27ec5c30d3b5 req-bf777baf-c8b7-4fa4-804c-6e9665b9d8db service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received unexpected event network-vif-plugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 for instance with vm_state building and task_state spawning.
May 13 02:17:37.692163 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:17:37.693861 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-0627b8e3-b98b-4d40-b3bb-3ccc1d8500b1 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.913s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:37.703015 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638657.7025633, 4c853575-60b7-45b0-9260-7d33471ac9d7 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:17:37.703288 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] VM Resumed (Lifecycle Event)
May 13 02:17:37.704471 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:17:37.709996 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance spawned successfully.
May 13 02:17:37.712822 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:17:37.914841 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] opening encrypted volume /dev/dm-3 {{(pid=98103) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 13 02:17:38.207107 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:38.212429 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:17:38.219247 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.219421 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.222122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.222122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.222122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.222122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:17:38.714742 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:17:38.727083 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Took 14.33 seconds to spawn the instance on the hypervisor.
May 13 02:17:38.727390 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:17:39.243466 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Took 22.69 seconds to build instance.
May 13 02:17:39.514455 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:39.744893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.202s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:39.779767 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-changed-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:39.781844 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Refreshing instance network info cache due to event network-changed-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:39.784163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] Acquiring lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:39.784163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] Acquired lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:39.784163 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Refreshing network info cache for port f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:40.045621 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-changed-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:40.046142 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Refreshing instance network info cache due to event network-changed-567b24a4-b872-4efc-bd7d-f283a0d19f27. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:17:40.046333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] Acquiring lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:17:40.046440 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] Acquired lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:17:40.046592 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Refreshing network info cache for port 567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:17:40.168213 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:40.289024 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:40.548426 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:40.676342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Attempting to attach volume d82d0e71-4d61-4068-9b11-16930335db8e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:17:40.679415 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:   <alias name="ua-d82d0e71-4d61-4068-9b11-16930335db8e"/>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:   <serial>d82d0e71-4d61-4068-9b11-16930335db8e</serial>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]: </disk>
May 13 02:17:40.679415 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:17:40.682300 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:40.850846 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updated VIF entry in instance network info cache for port f4d53f75-7660-4f0f-a50b-ccf1c69bd38d. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:17:40.851502 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating instance_info_cache with network_info: [{"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:40.945593 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:40.947529 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:41.074401 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updated VIF entry in instance network info cache for port 567b24a4-b872-4efc-bd7d-f283a0d19f27. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:17:41.074623 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating instance_info_cache with network_info: [{"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:41.354496 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f7a45690-cb68-4fdd-aecf-4c4b592b1771 req-0ac95b1b-2e78-422f-8bc2-9093947cb438 service nova] Releasing lock "refresh_cache-11f800e0-bd37-43d5-af19-094d2f69e137" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:41.576422 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fe64d346-8d3c-4177-8859-5b49a4f8dbde req-090e0575-32af-4088-b5cc-5ddbd6024c33 service nova] Releasing lock "refresh_cache-4c853575-60b7-45b0-9260-7d33471ac9d7" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:17:42.378183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:42.378183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:42.378183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:42.378183 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] No VIF found with MAC fa:16:3e:f1:d5:bc, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:17:43.930109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6c526f11-2c98-44f2-969b-380c8f84802f tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.623s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:44.442566 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:44.443154 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:44.528375 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:44.658170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:44.658170 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:44.947517 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:45.161114 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Detaching volume d82d0e71-4d61-4068-9b11-16930335db8e
May 13 02:17:45.200593 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Attempting to driver detach volume d82d0e71-4d61-4068-9b11-16930335db8e from mountpoint /dev/vdb
May 13 02:17:45.244596 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '5dd1c267-af4b-4892-b056-492f11daf856', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'serial': 'd82d0e71-4d61-4068-9b11-16930335db8e'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:17:45.250692 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-d82d0e71-4d61-4068-9b11-16930335db8e {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:17:45.251980 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Found disk vdb by alias ua-d82d0e71-4d61-4068-9b11-16930335db8e {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:17:45.252122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Attempting to detach device vdb from instance 5dd1c267-af4b-4892-b056-492f11daf856 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:17:45.252480 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <alias name="ua-d82d0e71-4d61-4068-9b11-16930335db8e"/>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <serial>d82d0e71-4d61-4068-9b11-16930335db8e</serial>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]: </disk>
May 13 02:17:45.252480 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:17:45.258559 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 5dd1c267-af4b-4892-b056-492f11daf856 from the persistent domain config.
May 13 02:17:45.258849 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] (1/8): Attempting to detach device vdb with device alias ua-d82d0e71-4d61-4068-9b11-16930335db8e from instance 5dd1c267-af4b-4892-b056-492f11daf856 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:17:45.259181 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <alias name="ua-d82d0e71-4d61-4068-9b11-16930335db8e"/>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <serial>d82d0e71-4d61-4068-9b11-16930335db8e</serial>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]: </disk>
May 13 02:17:45.259181 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:17:45.798137 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638665.7977374, 5dd1c267-af4b-4892-b056-492f11daf856 => ua-d82d0e71-4d61-4068-9b11-16930335db8e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:17:45.800342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d82d0e71-4d61-4068-9b11-16930335db8e for instance 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:17:45.803003 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully detached device vdb from instance 5dd1c267-af4b-4892-b056-492f11daf856 from the live domain config.
May 13 02:17:45.804645 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:17:45.804865 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:17:45.805040 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:17:45.805684 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x705c6c1653d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '5dd1c267-af4b-4892-b056-492f11daf856', 'attached_at': '', 'detached_at': '', 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'serial': 'd82d0e71-4d61-4068-9b11-16930335db8e'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:17:45.805823 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] closing encrypted volume /dev/dm-4 {{(pid=98103) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 13 02:17:45.841604 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:17:45.842143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:45.842415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:45.842947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:45.843419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd82d0e71-4d61-4068-9b11-16930335db8e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:17:45.843656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:17:45.871878 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:45.871878 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:45.871878 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:45.871878 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:45.871878 np0000000663 nova-compute[98103]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:45.871878 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: tcp: [178] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e (non-flash)
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: tcp: [179] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:45.872202 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:45.872202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', '177'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', '178'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37', '179')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:17:45.872428 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', '177')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:45.873523 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e', '178')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:17:45.874350 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c88284360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:17:45.874605 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:17:45.874882 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Flush multipath device 33000000028db47e9 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:17:45.909884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:45.950274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:45.952588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:45.954992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:17:45.997548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:17:45.997775 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:17:45.998767 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:17:46.012942 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:17:46.013114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:17:46.026347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.064690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 177, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.40.100,3260]
May 13 02:17:46.064690 np0000000663 nova-compute[98103]: Logout of [sid: 177, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.40.100,3260] successful.
May 13 02:17:46.064690 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.078279 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.090455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.118883 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.50.100,3260]
May 13 02:17:46.118883 np0000000663 nova-compute[98103]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-d82d0e71-4d61-4068-9b11-16930335db8e, portal: 192.168.50.100,3260] successful.
May 13 02:17:46.118883 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.134919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:46.138518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:46.138518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] <== disconnect_volume: return (293ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:46.138518 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:17:46.691732 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'flavor' on Instance uuid 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:47.031296 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:47.031738 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:47.031738 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attaching volume 7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 to /dev/vdb
May 13 02:17:47.067466 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:47.079053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:17:47.098744 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:47.148593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:17:47.148982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:17:47.158778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:17:47.160293 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fef1:d5bc', 'fe80::429:8eff:fe11:1b52', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:feb2:9545', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:17:47.160430 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:17:47.160567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:17:47.160847 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:47.161133 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating existing volume attachment record: 97f7b758-3556-48cb-964f-a51f6df8dfb8 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:17:47.704457 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-be3c9eb1-8bf5-4517-bed3-f40b76ba3800 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.047s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:47.707833 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:17:47.708135 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:47.708278 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:47.708660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:47.708838 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:17:47.719951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:47.720544 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:47.720879 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:47.721087 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:47.721363 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:47.724292 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:47.731709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:47.731709 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:47.736297 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:47.736297 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:47.743596 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8] added
May 13 02:17:47.743596 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:47.743596 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:47.743596 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:47.743596 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:47.743596 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:47.743596 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:47.743856 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:47.743890 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:47.744128 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:47.747427 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8] added
May 13 02:17:47.747427 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:47.747427 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:47.747427 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:47.747427 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:47.747427 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:47.747427 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:47.747618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:47.747773 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0235(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:47.747938 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:47.994819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:47.995026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:47.995263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:47.995423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:47.995572 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:47.997849 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Terminating instance
May 13 02:17:48.501215 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:17:48.521800 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.525717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.543172 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.546537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.568936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.570815 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:48.691656 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:48.693352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:48.693352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:48.693352 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:48.693882 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] No waiting events found dispatching network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:48.693882 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7dba4382-98ba-466f-bb16-88b1bde333f5 req-73bd3e2b-d3e9-491e-9e2e-c827a97f35d1 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:48.744696 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:48.753114 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:48.763645 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:48.763645 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:48.766303 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:48.766303 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.778146 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.780353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.796109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.796109 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.796109 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:48.796375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.796375 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.796375 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:48.797483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.797483 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.797483 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:48.797681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.797681 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.797681 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:48.831079 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999703818999933 future=<Future at 0x705c6c28dd30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:48.831299 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999460346999967 future=<Future at 0x705c6c28dd30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:48.831412 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999357185999997 future=<Future at 0x705c6c28dd30 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:17:48.833118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.40.100,3260]
May 13 02:17:48.833118 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.40.100,3260] successful.
May 13 02:17:48.833118 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.836997 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Instance destroyed successfully.
May 13 02:17:48.837761 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lazy-loading 'resources' on Instance uuid 5dd1c267-af4b-4892-b056-492f11daf856 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:48.841527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.50.100,3260]
May 13 02:17:48.841527 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.50.100,3260] successful.
May 13 02:17:48.841527 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.850261 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.859116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:48.866978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.866978 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.866978 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.866978 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.866978 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.867939 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:48.867939 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:48.868241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('9', '-', '-', 0) found on session 180 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:48.869107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:48.875864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.875864 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.875864 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.875864 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.875864 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:48.876709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.876709 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:48.876709 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.876709 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:48.876709 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:48.876709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:48.877510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:48.877839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('10', '-', '-', 0) found on session 181 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:48.877946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:48.887761 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 180 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:48.888053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:48.894814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 181 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:48.894814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:49.343417 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:16:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-664694500',display_name='tempest-TestEncryptedCinderVolumes-server-664694500',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-664694500',id=64,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxwYkz9KeXOs+vWMmjn8/B4RLbdPO/1OUA3w0bHM9qjc7xrSSYKQz5LCEBKVE0UG5zDghU9ovZFm4Br/xi6QKRcn5t6Rqz+qt/Njzdc/XzhpluKZhdtN2egc07n26qVxA==',key_name='tempest-keypair-850596137',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:16:44Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf4cdaf6da19497586ec83765be014b7',ramdisk_id='',reservation_id='r-p99on3n2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-1329189432',owner_user_name='tempest-TestEncryptedCinderVolumes-1329189432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63c9dc09e45e4cdeb438d163532a8849',uuid=5dd1c267-af4b-4892-b056-492f11daf856,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:17:49.343754 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converting VIF {"id": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "address": "fa:16:3e:f1:d5:bc", "network": {"id": "6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1798565360-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cf4cdaf6da19497586ec83765be014b7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6ccdfe-7e", "ovs_interfaceid": "5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:17:49.344256 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:17:49.344536 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:17:49.345900 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:49.346218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a6ccdfe-7e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:49.356250 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:49.356988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:49.357239 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee08b8d8-345a-41d9-9768-49e489bb50b3) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:17:49.359176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:17:49.360838 np0000000663 nova-compute[98103]: INFO os_vif [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9,network=Network(6ee3a7df-1f9d-4ac4-a2fe-b1b63a8cb7f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a6ccdfe-7e')
May 13 02:17:49.361276 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Deleting instance files /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856_del
May 13 02:17:49.362015 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Deletion of /opt/stack/data/nova/instances/5dd1c267-af4b-4892-b056-492f11daf856_del complete
May 13 02:17:49.721494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:17:49.867778 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 02:17:49.868371 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:17:49.868693 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:17:49.868844 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:17:49.869441 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:49.957123 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:17:50.740679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found WWN 33000000078579962 for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:17:50.741282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:50.741282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '33000000078579962', 'path': '/dev/dm-3', 'multipath_id': '33000000078579962'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:50.741282 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000078579962', 'path': '/dev/dm-3', 'multipath_id': '33000000078579962'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:17:50.744019 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] Acquiring lock "5dd1c267-af4b-4892-b056-492f11daf856-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] Lock "5dd1c267-af4b-4892-b056-492f11daf856-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] No waiting events found dispatching network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:17:50.754120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-unplugged-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:17:50.755022 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Received event network-vif-deleted-5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:17:50.755254 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Neutron deleted interface 5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9; detaching it from the instance and deleting it from the info cache
May 13 02:17:50.755380 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:50.796539 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:17:50.951386 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:51.246922 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to attach volume 7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:17:51.248901 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:   <alias name="ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8"/>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:   <serial>7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8</serial>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]: </disk>
May 13 02:17:51.248901 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:17:51.264217 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-74943bdd-76ec-4d6d-b1c7-a5b3828defb0 req-aac37e32-7c1b-4cad-ab35-2aa3e42d3166 service nova] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Detach interface failed, port_id=5a6ccdfe-7e8b-4e66-982f-f380d38fe7e9, reason: Instance 5dd1c267-af4b-4892-b056-492f11daf856 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:17:51.298452 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Took 1.43 seconds to deallocate network for instance.
May 13 02:17:51.804169 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:51.804453 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:52.101011 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:17:52.101213 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:17:52.603838 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:17:52.848379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:52.848736 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:52.894753 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:52.894864 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:52.894940 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:17:52.895064 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:c2:a8:78, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:17:53.110753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.306s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:53.173456 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Deleted allocations for instance 5dd1c267-af4b-4892-b056-492f11daf856
May 13 02:17:53.351529 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:54.183546 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-824f44ca-54a0-47de-b881-40f41239e513 tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Lock "5dd1c267-af4b-4892-b056-492f11daf856" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.188s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:54.296919 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:54.357308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:54.358751 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:54.448811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3a2666c9-ac0d-436a-9fb1-a4acb7b0f10e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.416s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:54.448983 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:54.953857 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:55.443014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:55.447157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:55.447157 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Attaching volume 3f0ff550-4813-4d44-a569-112599e256bf to /dev/vdb
May 13 02:17:55.490926 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:55.501267 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:17:55.524111 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:55.565969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:17:55.566498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:17:55.575540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:17:55.576956 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:feb2:9545', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:17:55.577306 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:17:55.578669 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:17:55.578669 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:55.578669 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating existing volume attachment record: 71aa5da0-1900-4d2e-85d5-2562390614fd {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:17:55.952377 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:55.960062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:17:56.127306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:17:56.127630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:56.127752 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:56.128300 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:56.128300 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:17:56.138806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:56.139459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:56.139906 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:56.140125 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:56.140483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:56.140709 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:56.154340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:56.154340 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:56.158887 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:56.158887 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf] added
May 13 02:17:56.165479 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:56.165479 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:56.165479 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:56.165758 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:56.165758 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:56.173694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf] added
May 13 02:17:56.173694 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:56.173694 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:56.173694 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:56.173694 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:56.173694 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:56.173694 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:56.174022 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:56.174068 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:56.174217 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:56.893578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:17:56.893973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:17:56.893973 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attaching volume 67be8013-d9a2-49c9-94ae-110d53f6151b to /dev/vdc
May 13 02:17:56.931250 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:56.941618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:17:56.961930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:17:57.006684 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:17:57.006944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:17:57.015647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:17:57.016878 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:feb2:9545', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:17:57.017044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:17:57.017143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:17:57.017507 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:57.017885 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating existing volume attachment record: 4a867f39-c954-4241-bb17-4cebb4a5bb5b {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:17:57.166501 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:57.175128 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:57.182468 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:57.182468 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:17:57.190286 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:17:57.190286 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.201108 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.212212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.221534 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.221534 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.221534 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.221534 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.221534 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.221534 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:57.221779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.221779 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.221779 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.221779 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.221779 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.221779 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:57.230244 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.230244 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.230244 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.230244 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.230244 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.230244 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:57.230462 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.230462 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.230462 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.230462 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.230462 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.230462 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:57.263918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.40.100,3260]
May 13 02:17:57.263918 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.40.100,3260] successful.
May 13 02:17:57.263918 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.276278 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.286496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.50.100,3260]
May 13 02:17:57.286496 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.50.100,3260] successful.
May 13 02:17:57.286496 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.293111 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.293289 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:57.293594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:57.293693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:57.294624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] HCTL ('12', '-', '-', 0) found on session 183 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:57.294730 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:57.301161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:57.308886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching for a device in session 183 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:57.309442 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.317200 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:17:57.317367 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:17:57.317637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:57.317696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:17:57.318543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] HCTL ('13', '-', '-', 0) found on session 184 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:17:57.318658 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:17:57.331612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching for a device in session 184 and hctl ['13', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:57.580512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:57.607574 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c19374b4-2270-4a5d-ba5c-251d9c52797e', 'attached_at': '', 'detached_at': '', 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'serial': '67be8013-d9a2-49c9-94ae-110d53f6151b'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:17:57.611762 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:17:57.612164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:17:57.612289 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:58.330862 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Searching for a device in session 184 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:17:58.331367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:17:59.159403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found WWN 330000000c8062eef for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:17:59.159403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:17:59.159652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000c8062eef', 'path': '/dev/dm-4', 'multipath_id': '330000000c8062eef'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:17:59.160206 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8062eef', 'path': '/dev/dm-4', 'multipath_id': '330000000c8062eef'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:17:59.160206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.548s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:59.160366 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:17:59.167730 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:17:59.182979 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:17:59.196920 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:59.196920 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:59.204027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:17:59.204027 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b] added
May 13 02:17:59.209130 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:59.209130 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:59.209130 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:59.214657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b] added
May 13 02:17:59.214657 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:17:59.214657 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:59.214657 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:59.214657 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:17:59.214657 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:17:59.214657 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:17:59.214896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:17:59.214965 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0343(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:17:59.215119 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:17:59.282132 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:59.364522 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:17:59.670797 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Attempting to attach volume 3f0ff550-4813-4d44-a569-112599e256bf with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:17:59.672611 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:   <alias name="ua-3f0ff550-4813-4d44-a569-112599e256bf"/>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:   <serial>3f0ff550-4813-4d44-a569-112599e256bf</serial>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]: </disk>
May 13 02:17:59.672611 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:18:00.208058 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:00.215539 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:00.221169 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:00.221169 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:00.229202 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:00.229202 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.234702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.242984 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.249795 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.263324 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.263628 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:00.288413 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.40.100,3260]
May 13 02:18:00.288413 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.40.100,3260] successful.
May 13 02:18:00.288413 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.303025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.312314 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.50.100,3260]
May 13 02:18:00.312314 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.50.100,3260] successful.
May 13 02:18:00.312314 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.320304 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('14', '-', '-', 0) found on session 185 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:00.320304 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:00.329112 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:00.340051 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 185 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:00.340565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.346577 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61dab338-f639-4d84-9f15-b96c90aa0f37 (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:00.346798 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:00.346975 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:00.347111 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:00.347915 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('15', '-', '-', 0) found on session 186 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:00.348015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:00.362605 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 186 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:00.362860 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:00.954118 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:01.181115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:18:01.323900 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:01.324182 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:01.324450 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:01.324676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] No VIF found with MAC fa:16:3e:b2:95:45, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:02.199724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found WWN 3300000008c746905 for multipath device dm-5 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:18:02.200259 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:02.201536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== connect_volume: return (4588ms) {'type': 'block', 'scsi_wwn': '3300000008c746905', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000008c746905'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:02.201679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008c746905', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000008c746905'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:18:02.206062 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:18:02.206232 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:02.206383 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:02.225005 np0000000663 nova-compute[98103]: WARNING os_brick.encryptors.luks [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 13 02:18:02.225323 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:18:02.225485 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:02.225631 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:02.226104 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x705c9239c950>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'c19374b4-2270-4a5d-ba5c-251d9c52797e', 'attached_at': '', 'detached_at': '', 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'serial': '67be8013-d9a2-49c9-94ae-110d53f6151b'} {{(pid=98103) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 13 02:18:02.226254 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors.luks [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] formatting encrypted volume /dev/dm-5 {{(pid=98103) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 13 02:18:02.877027 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d092ccc-e840-431c-8d2d-935e030949de tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.433s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:03.578963 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:03.831310 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0005139770000823773 future=<Future at 0x705c6c28dd30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:03.831524 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:03.832890 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638668.8306763, 5dd1c267-af4b-4892-b056-492f11daf856 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:03.833171 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] VM Stopped (Lifecycle Event)
May 13 02:18:04.339587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5dd1c267-af4b-4892-b056-492f11daf856] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:04.376240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:05.917198 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:05.919485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:05.956644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:06.220826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:06.338116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:18:06.338116 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:18:06.338116 np0000000663 nova-compute[98103]:     <volume>67be8013-d9a2-49c9-94ae-110d53f6151b</volume>
May 13 02:18:06.338116 np0000000663 nova-compute[98103]:   </usage>
May 13 02:18:06.338116 np0000000663 nova-compute[98103]: </secret>
May 13 02:18:06.338116 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:18:06.345145 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:06.421340 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Detaching volume 3f0ff550-4813-4d44-a569-112599e256bf
May 13 02:18:06.455815 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Attempting to driver detach volume 3f0ff550-4813-4d44-a569-112599e256bf from mountpoint /dev/vdb
May 13 02:18:06.460862 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found disk vdb by alias ua-3f0ff550-4813-4d44-a569-112599e256bf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:18:06.464939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Found disk vdb by alias ua-3f0ff550-4813-4d44-a569-112599e256bf {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:18:06.464939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Attempting to detach device vdb from instance 1451f9e6-0d3b-423d-9475-eef08937c6fb from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:18:06.464939 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <alias name="ua-3f0ff550-4813-4d44-a569-112599e256bf"/>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <serial>3f0ff550-4813-4d44-a569-112599e256bf</serial>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:06.464939 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:18:06.468703 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully detached device vdb from instance 1451f9e6-0d3b-423d-9475-eef08937c6fb from the persistent domain config.
May 13 02:18:06.468926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] (1/8): Attempting to detach device vdb with device alias ua-3f0ff550-4813-4d44-a569-112599e256bf from instance 1451f9e6-0d3b-423d-9475-eef08937c6fb from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:18:06.469242 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <alias name="ua-3f0ff550-4813-4d44-a569-112599e256bf"/>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <serial>3f0ff550-4813-4d44-a569-112599e256bf</serial>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:06.469242 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:18:06.853950 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to attach volume 67be8013-d9a2-49c9-94ae-110d53f6151b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:18:06.856442 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <alias name="ua-67be8013-d9a2-49c9-94ae-110d53f6151b"/>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <serial>67be8013-d9a2-49c9-94ae-110d53f6151b</serial>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="3b9eb462-9ecd-42fc-9748-b9ca85d40734"/>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:06.856442 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:18:07.089472 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638687.0890567, 1451f9e6-0d3b-423d-9475-eef08937c6fb => ua-3f0ff550-4813-4d44-a569-112599e256bf> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:18:07.093548 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3f0ff550-4813-4d44-a569-112599e256bf for instance 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:18:07.096177 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully detached device vdb from instance 1451f9e6-0d3b-423d-9475-eef08937c6fb from the live domain config.
May 13 02:18:07.097847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:18:07.098186 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:07.098429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:08.583936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:08.782152 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.782433 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.782630 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.782945 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.783147 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.783490 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.783634 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.784939 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:08.784939 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:18:08.784939 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:18:09.288158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:09.288388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:09.288551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:09.288722 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:18:09.378031 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:09.552747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:09.552747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:09.552747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:09.552747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:09.552747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:c2:a8:78, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:10.056478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.958s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:10.057954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f0ff550-4813-4d44-a569-112599e256bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:18:10.058077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:10.085637 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:10.086002 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', '184'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8', '187')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:18:10.086002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', '183')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:18:10.086969 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf', '184')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:18:10.087929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c708b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'): ({'sdh'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:18:10.087929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Removing multipathed devices sdh, sdg {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:18:10.088196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Flush multipath device 330000000c8062eef {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:18:10.128597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:18:10.165175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:18:10.167217 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:18:10.199372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:18:10.199542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:18:10.200543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:18:10.211515 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:18:10.211672 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:18:10.222520 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.255579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.40.100,3260]
May 13 02:18:10.255579 np0000000663 nova-compute[98103]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.40.100,3260] successful.
May 13 02:18:10.255579 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.271914 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.283610 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.318030 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.50.100,3260]
May 13 02:18:10.318030 np0000000663 nova-compute[98103]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-3f0ff550-4813-4d44-a569-112599e256bf, portal: 192.168.50.100,3260] successful.
May 13 02:18:10.318030 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.319471 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:18:10.324439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.349660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:10.349889 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:10.350081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] <== disconnect_volume: return (3251ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:10.350284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:18:10.388787 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:10.425478 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.426130 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.520856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.520856 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:18:10.520856 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:18:10.524623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.614216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.615009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.712150 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.715158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.807084 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.807620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.899206 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:10.904471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:10.929280 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'flavor' on Instance uuid 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:10.958955 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:11.023962 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:11.023962 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:11.101562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3c336998-3b41-4d32-95a8-2df22e63b6dc tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.208s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:11.113980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:11.118644 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:18:11.119877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:11.169493 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:11.170422 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12120MB free_disk=72.656005859375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:18:11.170602 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:11.170896 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:11.939333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2518489c-48ca-426b-88af-d581b9b730d4 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.021s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:12.083274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:12.083274 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:12.186303 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-changed-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:12.190145 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing instance network info cache due to event network-changed-397043a4-0f01-45fb-b47e-188546902296. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:12.190562 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] Acquiring lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:12.191254 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] Acquired lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:12.191555 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Refreshing network info cache for port 397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:12.235466 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 3fe8732c-63d4-4c50-950b-791d81d36975 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:18:12.236085 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance c19374b4-2270-4a5d-ba5c-251d9c52797e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:18:12.236085 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 1451f9e6-0d3b-423d-9475-eef08937c6fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:18:12.236085 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 4c853575-60b7-45b0-9260-7d33471ac9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:18:12.236085 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 11f800e0-bd37-43d5-af19-094d2f69e137 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:18:12.236287 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:18:12.236767 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:18:11 up 42 min,  2 users,  load average: 5.31, 6.76, 5.30\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_9b5475f08f0a44c4a95ec0ce67c5f366': '2', 'io_workload': '0', 'num_proj_7a3847aeaf9841b199e63d3c1c099c9f': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1', 'num_proj_57dfe4c819c84128b0149ebe05ecf5be': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:18:12.479666 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:12.479966 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:12.589724 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:12.613355 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:12.613545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:12.613767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:12.613873 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:12.614006 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:12.617420 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Terminating instance
May 13 02:18:12.695875 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:12.982632 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:12.989960 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:13.121755 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:18:13.129983 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updated VIF entry in instance network info cache for port 397043a4-0f01-45fb-b47e-188546902296. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:13.130327 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [{"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:13.148024 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.153378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.173570 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.274868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.278677 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.425360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.432874 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.451752 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999639829999978 future=<Future at 0x705c486d7d40 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:13.452553 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999290140000085 future=<Future at 0x705c486d7d40 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:13.452553 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999122838999938 future=<Future at 0x705c486d7d40 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:13.453887 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Instance destroyed successfully.
May 13 02:18:13.454968 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'resources' on Instance uuid 1451f9e6-0d3b-423d-9475-eef08937c6fb {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:13.493519 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:18:13.495707 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.323s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:13.495707 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:18:13.518525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:13.518691 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:13.594607 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:13.633195 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-eeb82f50-8e22-480c-8ed8-ee87efd1cf1e req-505d90d3-2a1c-4ccf-94a5-6b4899251de6 service nova] Releasing lock "refresh_cache-1451f9e6-0d3b-423d-9475-eef08937c6fb" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:13.956883 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:17:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1972435748',display_name='tempest-TestStampPattern-server-1972435748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1972435748',id=67,image_ref='6d9ea03e-2be7-4b06-8757-b9f6303d00ab',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:17:14Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-i8ccyx3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3fe8732c-63d4-4c50-950b-791d81d36975',image_min_disk='1',image_min_ram='0',image_owner_id='9b5475f08f0a44c4a95ec0ce67c5f366',image_owner_project_name='tempest-TestStampPattern-185105098',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-185105098-project-member',image_user_id='86981c5164f4476893f3937fe22f5a40',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:17:14Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=1451f9e6-0d3b-423d-9475-eef08937c6fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:18:13.957912 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "397043a4-0f01-45fb-b47e-188546902296", "address": "fa:16:3e:b2:95:45", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap397043a4-0f", "ovs_interfaceid": "397043a4-0f01-45fb-b47e-188546902296", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:13.958722 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:13.959136 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:18:13.960895 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.961253 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397043a4-0f, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:13.964425 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:13.965066 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:13.965278 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4374505-1a7f-4b11-a9a5-acf24d72425d) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:13.967119 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:13.968734 np0000000663 nova-compute[98103]: INFO os_vif [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:95:45,bridge_name='br-int',has_traffic_filtering=True,id=397043a4-0f01-45fb-b47e-188546902296,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397043a4-0f')
May 13 02:18:13.969107 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Deleting instance files /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb_del
May 13 02:18:13.969747 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Deletion of /opt/stack/data/nova/instances/1451f9e6-0d3b-423d-9475-eef08937c6fb_del complete
May 13 02:18:14.020600 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:18:14.253922 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:14.254145 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:14.254550 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:14.254550 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:14.254550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] No waiting events found dispatching network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:14.254706 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:14.254755 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:14.254852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Acquiring lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:14.254973 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:14.255069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:14.255209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] No waiting events found dispatching network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:14.255306 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e41c6a9f-790c-456d-a34e-14933c2619fe req-7179fab2-4ffb-4f37-9a42-d7b8d07f0bd8 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-unplugged-397043a4-0f01-45fb-b47e-188546902296 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:14.475795 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Took 1.35 seconds to destroy the instance on the hypervisor.
May 13 02:18:14.476343 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:18:14.476550 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:18:14.476632 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:18:14.476835 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:14.539779 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:14.572469 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:14.572791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:14.576824 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:18:14.576999 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Claim successful on node np0000000663
May 13 02:18:14.649680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:14.649680 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:14.649680 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attaching volume bd72a680-95f9-4bf0-b217-04618c8cf4fa to /dev/vdd
May 13 02:18:14.684903 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:14.695409 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:18:14.719787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:14.778962 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:18:14.779265 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:18:14.788579 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:18:14.792525 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:18:14.792677 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:18:14.792771 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:18:14.793027 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:14.793262 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating existing volume attachment record: 9d9da0dc-1ecd-404e-bf3e-70cadc8c5c4c {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:18:14.860871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e272d585-5f67-439e-b008-227f2b0dfca4 req-cbbf6b9f-ee74-4ed7-aaee-f481d71b6c45 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Received event network-vif-deleted-397043a4-0f01-45fb-b47e-188546902296 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:14.860955 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-e272d585-5f67-439e-b008-227f2b0dfca4 req-cbbf6b9f-ee74-4ed7-aaee-f481d71b6c45 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Neutron deleted interface 397043a4-0f01-45fb-b47e-188546902296; detaching it from the instance and deleting it from the info cache
May 13 02:18:14.861157 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e272d585-5f67-439e-b008-227f2b0dfca4 req-cbbf6b9f-ee74-4ed7-aaee-f481d71b6c45 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:15.297845 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:15.343555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:15.343998 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:15.348820 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:18:15.349222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:15.349372 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:15.349787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:15.350395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:18:15.361527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:15.362225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:15.363281 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:15.363474 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:15.364129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:15.364536 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:15.365968 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e272d585-5f67-439e-b008-227f2b0dfca4 req-cbbf6b9f-ee74-4ed7-aaee-f481d71b6c45 service nova] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Detach interface failed, port_id=397043a4-0f01-45fb-b47e-188546902296, reason: Instance 1451f9e6-0d3b-423d-9475-eef08937c6fb could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:18:15.374827 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:15.374827 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:15.379702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:15.379702 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:15.385549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa] added
May 13 02:18:15.385549 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:15.385549 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:15.385549 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:15.385549 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:15.385549 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:15.385549 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:15.385852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:15.385852 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:15.385973 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:15.393533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa] added
May 13 02:18:15.393533 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:15.393533 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:15.393533 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:15.393533 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:15.393533 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:15.393533 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:15.393857 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:15.394072 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:15.394281 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:15.801395 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Took 1.32 seconds to deallocate network for instance.
May 13 02:18:15.852289 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'flavor' on Instance uuid 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:15.885844 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:15.886067 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:15.977338 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:16.311217 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:16.386498 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:16.388916 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:16.394900 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:16.401759 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:16.401759 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:16.410047 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:16.410047 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.416813 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.425545 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.437293 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.437642 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.442488 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.442759 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:16.475853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.40.100,3260]
May 13 02:18:16.475853 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.40.100,3260] successful.
May 13 02:18:16.475853 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.486699 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.50.100,3260]
May 13 02:18:16.486699 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.50.100,3260] successful.
May 13 02:18:16.486699 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.492109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.497637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.512074 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.512499 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:16.512671 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:16.512953 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.513533 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:16.513747 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:16.514419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:16.514583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:16.516527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('12', '-', '-', 0) found on session 188 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:16.516732 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:16.517211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('13', '-', '-', 0) found on session 189 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:16.517350 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:16.531384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 188 and hctl ['12', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:16.535837 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 189 and hctl ['13', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:16.861137 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:16.896524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.324s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:16.897099 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.586s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:16.897287 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:18:17.208046 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:17.208258 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:17.406400 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:18:17.406661 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:18:17.406951 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:17.407240 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:17.486451 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b8270e949dc4210bf691de82ed07e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad986512b43843d28a756102ac971343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:18:17.529152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 188 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:17.529376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:17.534533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 189 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:17.534687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:17.710910 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:17.854039 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Successfully created port: 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:18:17.909682 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:18:17.932697 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:17.932945 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:17.933213 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Attaching volume 712f18f2-4ab5-4fca-91ba-c31908e9111d to /dev/vdb
May 13 02:18:17.967081 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:17.979921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:18:18.021456 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:18.067612 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:18:18.067918 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:18:18.076964 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:18:18.078551 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5e:bbd0', 'fe80::58ff:a2ff:fe1a:1413', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:18:18.078709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:18:18.079001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:18:18.079386 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:18.079514 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating existing volume attachment record: 2a00a64a-73c0-474a-8d34-f9b1e23ba5b9 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:18:18.222753 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.325s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:18.276979 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Deleted allocations for instance 1451f9e6-0d3b-423d-9475-eef08937c6fb
May 13 02:18:18.324859 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Successfully updated port: 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:18:18.365680 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:18:18.385840 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:18.386152 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing instance network info cache due to event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:18.386368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:18.386368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:18.386368 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:18.412743 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:18:18.664070 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '11f800e0-bd37-43d5-af19-094d2f69e137', 'attached_at': '', 'detached_at': '', 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'serial': '712f18f2-4ab5-4fca-91ba-c31908e9111d'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:18:18.667037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:18:18.668193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:18.668193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:18.826845 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:18.888834 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:18.959138 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:18.966889 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:19.122235 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:19.288245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-23e63f6a-8001-40fd-8874-337338e1c910 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "1451f9e6-0d3b-423d-9475-eef08937c6fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.675s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:19.382602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found WWN 330000000ed3ff9d0 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:18:19.383846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:19.384631 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.717s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:19.385000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '330000000ed3ff9d0', 'path': '/dev/dm-4', 'multipath_id': '330000000ed3ff9d0'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:19.386161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:18:19.386441 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed3ff9d0', 'path': '/dev/dm-4', 'multipath_id': '330000000ed3ff9d0'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:18:19.392377 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:19.399117 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:19.410384 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:19.410384 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:19.415456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:19.415456 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:19.421214 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d] added
May 13 02:18:19.424406 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:19.424406 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:19.424406 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Creating image(s)
May 13 02:18:19.424996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:19.425215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:19.425681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:19.426014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:19.426397 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:19.429038 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d] added
May 13 02:18:19.429038 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:19.429038 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:19.429038 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:19.429038 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:19.429038 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:19.429038 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:19.429233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:19.429335 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:19.429459 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:19.627483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-02154e9f-d6b3-47a7-bfb3-aea802ef451c req-14fa2c77-0846-47a1-b307-23401932fbba service nova] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:19.628830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:19.629051 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:18:19.840462 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:19.843004 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:19.843299 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:19.897440 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to attach volume bd72a680-95f9-4bf0-b217-04618c8cf4fa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:18:19.900803 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <target dev="vdd" bus="virtio"/>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:19.900803 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:18:19.930682 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.part --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:19.931197 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] 2cf52914-ccbd-4f24-bbbc-332fd218a34e was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:18:19.931739 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:18:19.932030 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.part /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.091842 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.part /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.converted" returned: 0 in 0.159s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.096497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.198954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c.converted --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.199598 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.773s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:20.199997 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:20.203933 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:20.207269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.231401 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:20.312381 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.313362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:20.313362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:20.313621 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:20.316288 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:20.316288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.424455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.424811 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:20.425493 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c,backing_fmt=raw /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.439855 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:20.446736 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:20.446736 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:20.454861 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:20.454861 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.463536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.470510 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:20.478651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.482694 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.483336 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.495810 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:20.500954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c,backing_fmt=raw /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk 1073741824" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.500954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "4cfb49569271a42f4c26ca77b4d2c93a5da7559c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:20.500954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.544881 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.40.100,3260]
May 13 02:18:20.544881 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.40.100,3260] successful.
May 13 02:18:20.544881 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.552788 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.50.100,3260]
May 13 02:18:20.552788 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.50.100,3260] successful.
May 13 02:18:20.552788 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.563113 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.567277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.583809 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.584106 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:20.584508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:20.584643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:20.586042 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('16', '-', '-', 0) found on session 190 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:20.586198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.594527 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:20.594798 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:20.595039 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:20.595122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:20.598223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('17', '-', '-', 0) found on session 191 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:20.598223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:20.608924 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.608924 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:18:20.608924 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:20.624432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 190 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:20.624432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:20.625747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 191 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:20.625884 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:20.671244 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:20.700524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:20.700901 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Cannot resize image /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:18:20.701479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:18:20.701991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Ensure instance console log exists: /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:18:20.702290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:20.702496 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:20.702647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:20.977867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.082971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:21.083569 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:21.173399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:21.173838 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance network_info: |[{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:18:21.175997 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start _get_guest_xml network_info=[{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:18:11Z,direct_url=<?>,disk_format='qcow2',id=2cf52914-ccbd-4f24-bbbc-332fd218a34e,min_disk=0,min_ram=0,name='tempest-scenario-img--332122038',owner='ad986512b43843d28a756102ac971343',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:18:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '2cf52914-ccbd-4f24-bbbc-332fd218a34e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:18:21.180785 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:18:21.182192 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2cf52914-ccbd-4f24-bbbc-332fd218a34e', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1460398376', uuid='75ef4b67-07c0-4399-9d88-d5a6c77207a8'), owner=OwnerMeta(userid='5b8270e949dc4210bf691de82ed07e0d', username='tempest-TestMinimumBasicScenario-1453218982-project-member', projectid='ad986512b43843d28a756102ac971343', projectname='tempest-TestMinimumBasicScenario-1453218982'), image=ImageMeta(id='2cf52914-ccbd-4f24-bbbc-332fd218a34e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638701.1818063) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:18:21.183336 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:18:21.184032 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:18:21.184796 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:18:21.184985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:18:21.186267 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:18:21.186775 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:18:11Z,direct_url=<?>,disk_format='qcow2',id=2cf52914-ccbd-4f24-bbbc-332fd218a34e,min_disk=0,min_ram=0,name='tempest-scenario-img--332122038',owner='ad986512b43843d28a756102ac971343',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:18:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:18:21.186872 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:18:21.186922 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:18:21.187177 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:18:21.187177 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:18:21.187316 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:18:21.187503 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:18:21.187668 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:18:21.187825 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:18:21.187951 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:18:21.188109 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:18:21.202784 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:18Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:18:21.202960 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:21.203680 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:21.204599 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'pci_devices' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:21.398618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:18:21.551271 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:21.551400 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:21.551473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:21.551537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:21.551630 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:21.551718 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:c2:a8:78, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:21.585448 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:18:21.707675 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <uuid>75ef4b67-07c0-4399-9d88-d5a6c77207a8</uuid>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <name>instance-00000046</name>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestMinimumBasicScenario-server-1460398376</nova:name>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:18:21</nova:creationTime>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:image uuid="2cf52914-ccbd-4f24-bbbc-332fd218a34e">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:user uuid="5b8270e949dc4210bf691de82ed07e0d">tempest-TestMinimumBasicScenario-1453218982-project-member</nova:user>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:project uuid="ad986512b43843d28a756102ac971343">tempest-TestMinimumBasicScenario-1453218982</nova:project>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="2cf52914-ccbd-4f24-bbbc-332fd218a34e"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         <nova:port uuid="1effd6a6-381d-4c92-b42b-ca4eb0f6200f">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <system>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="serial">75ef4b67-07c0-4399-9d88-d5a6c77207a8</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="uuid">75ef4b67-07c0-4399-9d88-d5a6c77207a8</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </system>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <os>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </os>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <features>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </features>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   <devices>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:35:47:9e"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <target dev="tap1effd6a6-38"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </interface>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/console.log" append="off"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </serial>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <video>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </video>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </rng>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:   </devices>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]: </domain>
May 13 02:18:21.707675 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Preparing to wait for external event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:18Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:21.710559 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:18:21.711653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.711897 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:21.712126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:18:21.713012 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.713187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0094132b-4af9-5dee-b926-d23b3a5775f7', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:21.727018 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.727633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.727903 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:21.729041 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.731198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.731361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1effd6a6-38, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:21.731759 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1effd6a6-38, col_values=(('qos', UUID('a257c1a2-2bac-44fe-8241-3df40fe7dfd4')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:21.731911 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1effd6a6-38, col_values=(('external_ids', {'iface-id': '1effd6a6-381d-4c92-b42b-ca4eb0f6200f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:47:9e', 'vm-uuid': '75ef4b67-07c0-4399-9d88-d5a6c77207a8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:21.733871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:21.739530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:21.740561 np0000000663 nova-compute[98103]: INFO os_vif [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38')
May 13 02:18:22.109764 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:22.109945 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing instance network info cache due to event network-changed-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:22.110124 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] Acquiring lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:22.110232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] Acquired lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:22.110362 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Refreshing network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:22.149952 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:22.150640 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:22.153976 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:18:22.154144 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Claim successful on node np0000000663
May 13 02:18:22.413612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Found WWN 3300000002a0b4a56 for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:18:22.414236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:22.414866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== connect_volume: return (3747ms) {'type': 'block', 'scsi_wwn': '3300000002a0b4a56', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000002a0b4a56'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:22.414983 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002a0b4a56', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '3300000002a0b4a56'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:18:22.416741 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:18:22.416915 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:22.417044 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:18:22.430179 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:18:22.430179 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:18:22.430179 np0000000663 nova-compute[98103]:     <volume>712f18f2-4ab5-4fca-91ba-c31908e9111d</volume>
May 13 02:18:22.430179 np0000000663 nova-compute[98103]:   </usage>
May 13 02:18:22.430179 np0000000663 nova-compute[98103]: </secret>
May 13 02:18:22.430179 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:18:22.435323 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'flavor' on Instance uuid 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:22.613611 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:22.627120 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:22.627318 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:22.627509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:22.627638 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:22.627735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:22.629845 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Terminating instance
May 13 02:18:22.854943 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:22.938273 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Attempting to attach volume 712f18f2-4ab5-4fca-91ba-c31908e9111d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:18:22.939904 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <alias name="ua-712f18f2-4ab5-4fca-91ba-c31908e9111d"/>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <serial>712f18f2-4ab5-4fca-91ba-c31908e9111d</serial>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="46b16081-8217-405e-9734-2e7be8721662"/>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:22.939904 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:18:22.972518 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updated VIF entry in instance network info cache for port a92a4af2-d56d-47be-b6b3-3fcc570ddc3a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:22.972780 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating instance_info_cache with network_info: [{"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:23.094844 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bcefca98-a420-4fc4-91bc-809f22e089f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.445s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:23.132628 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:18:23.153835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.156860 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.175048 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.178379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.195588 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.204823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.266493 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:23.267965 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:23.268133 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No VIF found with MAC fa:16:3e:35:47:9e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:23.268723 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Using config drive
May 13 02:18:23.456628 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999743012999716 future=<Future at 0x705c4865f9b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:23.458672 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Instance destroyed successfully.
May 13 02:18:23.458935 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lazy-loading 'resources' on Instance uuid 3fe8732c-63d4-4c50-950b-791d81d36975 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:23.476351 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-33e28c06-2f7a-44c7-bcd9-2ec86d391c32 req-a0182ccf-79ad-4679-9df8-cd0066109e6f service nova] Releasing lock "refresh_cache-3fe8732c-63d4-4c50-950b-791d81d36975" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:23.524768 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:23.524962 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:23.774756 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:23.894147 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Creating config drive at /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config
May 13 02:18:23.896927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp496lrdhy {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:23.952774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp496lrdhy" returned: 0 in 0.056s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:23.961414 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:15:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1316139097',display_name='tempest-TestStampPattern-server-1316139097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-teststamppattern-server-1316139097',id=62,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3KKOxef3U4ZJTCXIm0w+XQu0ATeUMwiflLp9Mt8rVyeQvm3LzNUFkYdGBHtqLhMnFeth0XFTdoY8iIxXp+SE9okB0VHLg8XeHJnuBwvdWja3AmPTLPug6x7TOBbg/oRQ==',key_name='tempest-TestStampPattern-836271007',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:15:52Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b5475f08f0a44c4a95ec0ce67c5f366',ramdisk_id='',reservation_id='r-ygi8xtmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-185105098',owner_user_name='tempest-TestStampPattern-185105098-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:16:59Z,user_data=None,user_id='86981c5164f4476893f3937fe22f5a40',uuid=3fe8732c-63d4-4c50-950b-791d81d36975,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:18:23.961625 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converting VIF {"id": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "address": "fa:16:3e:5e:bb:d0", "network": {"id": "5c79229f-1723-4df8-9615-751fa850da9c", "bridge": "br-int", "label": "tempest-TestStampPattern-847344984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b5475f08f0a44c4a95ec0ce67c5f366", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa92a4af2-d5", "ovs_interfaceid": "a92a4af2-d56d-47be-b6b3-3fcc570ddc3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:23.962379 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:23.962739 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:18:23.964235 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.964541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa92a4af2-d5, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:23.965741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.966857 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:23.974340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.975154 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.975276 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc523ce-a4f5-4a29-be50-fd0c836c9c9a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:23.975770 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.976205 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:23.980866 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:23.982774 np0000000663 nova-compute[98103]: INFO os_vif [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:bb:d0,bridge_name='br-int',has_traffic_filtering=True,id=a92a4af2-d56d-47be-b6b3-3fcc570ddc3a,network=Network(5c79229f-1723-4df8-9615-751fa850da9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa92a4af2-d5')
May 13 02:18:23.983071 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Deleting instance files /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975_del
May 13 02:18:23.984058 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Deletion of /opt/stack/data/nova/instances/3fe8732c-63d4-4c50-950b-791d81d36975_del complete
May 13 02:18:24.027927 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] No waiting events found dispatching network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:24.178576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:24.179023 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:24.180176 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Acquiring lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:24.180474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:24.180474 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] Lock "3fe8732c-63d4-4c50-950b-791d81d36975-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:24.180697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] No waiting events found dispatching network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:24.180697 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-edaf7f46-53a3-40ed-b5e9-511e1ad4833c req-1fd147c0-cbb6-40ba-9b34-eaee6bc2e8c1 service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-unplugged-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:24.381031 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:24.403200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:24.404107 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:24.494022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:24.494929 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Took 1.36 seconds to destroy the instance on the hypervisor.
May 13 02:18:24.495834 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:18:24.496399 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:18:24.496479 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:18:24.496809 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:24.536083 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.385s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:24.537344 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:18:24.586866 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:24.672972 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:24.700911 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:25.041797 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:18:25.043975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:18:25.044289 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:18:25.044610 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:25.044896 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:25.108555 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:18:25.231580 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638705.2311811, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:25.231809 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Started (Lifecycle Event)
May 13 02:18:25.373581 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:25.427818 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:25.427959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:25.428053 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:25.428164 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No VIF found with MAC fa:16:3e:0b:d1:89, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:25.489276 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Successfully created port: 2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:18:25.547042 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:18:25.655018 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:25.655421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:25.734177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:25.736582 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638705.7364142, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:25.736690 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Paused (Lifecycle Event)
May 13 02:18:25.875530 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Took 1.38 seconds to deallocate network for instance.
May 13 02:18:25.979192 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:26.052254 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Booting with volume snapshot 30bf0dcd-0397-450b-bef1-330283ae14c4 at /dev/vda
May 13 02:18:26.157013 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:18:26.240704 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:26.246392 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Processing event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:26.251950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:26.253583 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:26.253583 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:26.253583 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received unexpected event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with vm_state building and task_state spawning.
May 13 02:18:26.253804 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb3ee176-1796-45c8-8cd2-f285ff99b434 req-c740aa97-bf16-4039-ac57-bf7bcf92836c service nova] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Received event network-vif-deleted-a92a4af2-d56d-47be-b6b3-3fcc570ddc3a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:26.254467 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:18:26.259679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:18:26.261983 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance spawned successfully.
May 13 02:18:26.264334 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:18:26.362300 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Successfully updated port: 2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:18:26.380906 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:26.381394 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:26.411798 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-changed-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:26.411929 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Refreshing instance network info cache due to event network-changed-2c46fb13-a886-4fa7-b212-f41cd7e567ed. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:26.412072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] Acquiring lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:26.412501 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] Acquired lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:26.412501 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Refreshing network info cache for port 2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:26.710555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:26.755515 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:18:26.756771 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638706.7564914, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:26.756887 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Resumed (Lifecycle Event)
May 13 02:18:26.762357 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:26.762536 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:26.769846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.769990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.770351 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.770547 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.770813 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.771052 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:26.865406 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:26.918544 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:26.985638 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:26.989071 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-6e213107-a540-4408-a43c-d14174f4327b tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.056s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:27.106818 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:27.260658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:27.264148 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:27.265967 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:27.283549 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Took 7.86 seconds to spawn the instance on the hypervisor.
May 13 02:18:27.284670 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:27.608259 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-176d3106-1235-428c-b4da-1360f2de009f req-5b9ff94c-b2ba-4330-bd47-1ed9943889fa service nova] Releasing lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:27.608683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:27.608855 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:18:27.772064 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.391s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:27.773794 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:18:27.774263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.062s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:27.777843 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:18:27.778078 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Claim successful on node np0000000663
May 13 02:18:27.795188 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Took 13.27 seconds to build instance.
May 13 02:18:27.846038 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Deleted allocations for instance 3fe8732c-63d4-4c50-950b-791d81d36975
May 13 02:18:27.867409 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:27.867577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:28.198603 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:28.296616 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-874ac685-7e24-4345-8bfd-517034e39d59 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.778s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:28.357906 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:28.370583 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Detaching volume 712f18f2-4ab5-4fca-91ba-c31908e9111d
May 13 02:18:28.449866 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Attempting to driver detach volume 712f18f2-4ab5-4fca-91ba-c31908e9111d from mountpoint /dev/vdb
May 13 02:18:28.452054 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0006609179999941261 future=<Future at 0x705c486d7d40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:28.452170 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:28.452290 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=10.004058735999934 future=<Future at 0x705c4865f9b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:28.452384 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=10.00396333899971 future=<Future at 0x705c4865f9b0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:28.452811 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Emitting event <LifecycleEvent: 1778638693.451284, 1451f9e6-0d3b-423d-9475-eef08937c6fb => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:28.452974 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] VM Stopped (Lifecycle Event)
May 13 02:18:28.499389 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': '11f800e0-bd37-43d5-af19-094d2f69e137', 'attached_at': '', 'detached_at': '', 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'serial': '712f18f2-4ab5-4fca-91ba-c31908e9111d'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:18:28.508367 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Found disk vdb by alias ua-712f18f2-4ab5-4fca-91ba-c31908e9111d {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:18:28.511923 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Found disk vdb by alias ua-712f18f2-4ab5-4fca-91ba-c31908e9111d {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:18:28.511923 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Attempting to detach device vdb from instance 11f800e0-bd37-43d5-af19-094d2f69e137 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:18:28.511923 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <alias name="ua-712f18f2-4ab5-4fca-91ba-c31908e9111d"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <serial>712f18f2-4ab5-4fca-91ba-c31908e9111d</serial>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="46b16081-8217-405e-9734-2e7be8721662"/>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:28.511923 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:18:28.515403 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating instance_info_cache with network_info: [{"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:28.518709 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully detached device vdb from instance 11f800e0-bd37-43d5-af19-094d2f69e137 from the persistent domain config.
May 13 02:18:28.518983 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] (1/8): Attempting to detach device vdb with device alias ua-712f18f2-4ab5-4fca-91ba-c31908e9111d from instance 11f800e0-bd37-43d5-af19-094d2f69e137 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:18:28.519191 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <alias name="ua-712f18f2-4ab5-4fca-91ba-c31908e9111d"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <serial>712f18f2-4ab5-4fca-91ba-c31908e9111d</serial>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="46b16081-8217-405e-9734-2e7be8721662"/>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:28.519191 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:18:28.855936 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c6eb6b57-0878-4bf4-bd9e-4f9acb3543e0 tempest-TestStampPattern-185105098 tempest-TestStampPattern-185105098-project-member] Lock "3fe8732c-63d4-4c50-950b-791d81d36975" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.229s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:28.972733 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: 1451f9e6-0d3b-423d-9475-eef08937c6fb] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:28.977699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:29.017548 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:29.017787 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance network_info: |[{"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:18:29.211979 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:29.212204 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:29.305456 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638709.30428, 11f800e0-bd37-43d5-af19-094d2f69e137 => ua-712f18f2-4ab5-4fca-91ba-c31908e9111d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:18:29.306551 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-712f18f2-4ab5-4fca-91ba-c31908e9111d for instance 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:18:29.309418 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully detached device vdb from instance 11f800e0-bd37-43d5-af19-094d2f69e137 from the live domain config.
May 13 02:18:29.312507 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:18:29.312933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:29.313275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:29.313805 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:29.314275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '712f18f2-4ab5-4fca-91ba-c31908e9111d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:18:29.314524 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:29.341358 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:29.341660 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:29.341958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8', '192')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:18:29.342066 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '190')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:18:29.343084 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d', '191')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:18:29.343933 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c882794e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'): ({'sdl'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:18:29.344245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Removing multipathed devices sdk, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:18:29.344509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flush multipath device 3300000002a0b4a56 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:18:29.376375 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:18:29.422985 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:18:29.474209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:18:29.474370 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:18:29.475694 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:18:29.488990 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:18:29.489271 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:18:29.511510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.517765 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:29.538220 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:18:29.564404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.40.100,3260]
May 13 02:18:29.564404 np0000000663 nova-compute[98103]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.40.100,3260] successful.
May 13 02:18:29.564404 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.570013 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:29.584881 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.599714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.624353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:18:29.625042 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:18:29.638919 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:18:29.639850 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe0b:d189', 'fe80::9cba:3bff:fe2a:a965', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe35:479e', 'fe80::c045:1bff:fe01:bef'] 
May 13 02:18:29.640846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.50.100,3260]
May 13 02:18:29.640846 np0000000663 nova-compute[98103]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-712f18f2-4ab5-4fca-91ba-c31908e9111d, portal: 192.168.50.100,3260] successful.
May 13 02:18:29.640846 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.641683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:18:29.641683 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:18:29.642367 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:29.642977 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating existing volume attachment record: 72475377-038c-4cfb-854c-603e93711880 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:18:29.660882 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:29.662166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:29.662299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== disconnect_volume: return (349ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:29.662471 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:18:29.715803 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:30.224376 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.452s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:30.224969 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:18:30.241286 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'flavor' on Instance uuid 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:30.325151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:30.326427 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:30.414825 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:30.730933 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:18:30.731269 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:18:30.731598 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:30.731854 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:30.833229 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:30.836983 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4acc4ee8597744baa14224320669fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3847aeaf9841b199e63d3c1c099c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:18:30.980582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:31.233967 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:18:31.264277 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a684d6bc-37f0-4b30-b0c0-1fe6ea06cbe5 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.396s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:31.409261 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Successfully created port: 6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:18:31.738518 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:18:31.775895 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:18:31.777603 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:18:31.777894 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Creating image(s)
May 13 02:18:31.778403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:18:31.778572 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Ensure instance console log exists: /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:18:31.778897 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:31.779105 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:31.779278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:31.779965 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Start _get_guest_xml network_info=[{"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-13T02:18:17Z,direct_url=<?>,disk_format='raw',id=ba859633-6e08-4224-bbed-16d52ed104ba,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-980579657',owner='75f3a6b45e2d4a68b7fa986edb3c82a5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-13T02:18:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '59751567-2cc2-410c-a5e2-e7c98b6382c0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'serial': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799'}, 'attachment_id': '72475377-038c-4cfb-854c-603e93711880', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:18:31.786937 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:18:31.788590 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-693062471', uuid='59751567-2cc2-410c-a5e2-e7c98b6382c0'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='ba859633-6e08-4224-bbed-16d52ed104ba', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638711.788131) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:18:31.790539 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:18:31.791555 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:18:31.792909 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:18:31.793283 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:18:31.794428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:18:31.794746 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-13T02:18:17Z,direct_url=<?>,disk_format='raw',id=ba859633-6e08-4224-bbed-16d52ed104ba,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-980579657',owner='75f3a6b45e2d4a68b7fa986edb3c82a5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-13T02:18:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:18:31.794889 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:18:31.794960 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:18:31.795153 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:18:31.795258 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:18:31.795414 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:18:31.795593 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:18:31.795712 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:18:31.795864 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:18:31.796052 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:18:31.796243 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:18:31.808557 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:18:31.808864 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:31.808966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:31.809287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:31.809447 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:18:31.822963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:31.825672 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:31.826455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:31.826720 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:31.827526 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:31.828361 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:31.844021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:31.845207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:31.845207 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:31.853800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:31.853800 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:31.865660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799] added
May 13 02:18:31.865660 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:31.865660 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:31.865660 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:31.865660 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:31.865660 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:31.865660 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:31.867253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:31.867607 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:31.868154 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:31.868714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799] added
May 13 02:18:31.868714 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:31.868714 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:31.868714 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:31.868714 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:31.868714 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:31.868714 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:31.868977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:31.869101 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:31.869268 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:31.980850 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Successfully updated port: 6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:18:32.053133 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-changed-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:32.053133 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Refreshing instance network info cache due to event network-changed-6a3f0174-55c0-48be-b997-826d9b9311df. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:32.053133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] Acquiring lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:32.053133 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] Acquired lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:32.053133 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Refreshing network info cache for port 6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:32.186378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:32.324620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:32.325049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:32.325049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:32.325448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:32.325448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:32.328405 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Terminating instance
May 13 02:18:32.482416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:32.554136 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:32.635932 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:32.751530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:18:32.752535 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:18:32.752788 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Creating image(s)
May 13 02:18:32.755199 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:32.755411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:32.755905 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:32.756728 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:32.761046 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:32.762784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:32.829878 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:32.834192 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:18:32.855345 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:32.864483 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:32.869863 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:32.869863 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:32.874651 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:32.875445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:32.875907 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:32.876377 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:32.883439 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:32.884476 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:18:32.884868 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:32.900260 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:32.900260 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:32.904876 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:32.904876 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:32.908013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:32.914153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:32.914153 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:32.914153 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attaching volume 5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c to /dev/vdb
May 13 02:18:32.917817 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:32.923818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:32.937459 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:32.937948 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:32.953498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:32.975575 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:32.987235 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:18:32.989213 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:32.989213 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:33.007326 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.50.100,3260]
May 13 02:18:33.007326 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.50.100,3260] successful.
May 13 02:18:33.007326 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:33.014179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.40.100,3260]
May 13 02:18:33.014179 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.40.100,3260] successful.
May 13 02:18:33.014179 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:33.018113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:33.035594 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:33.041580 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:33.056138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:33.060880 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:33.061203 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:33.061740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:33.062172 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] No waiting events found dispatching network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:33.062397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-098307d6-127f-4fc4-aed2-612917db5b47 req-aa0e2770-7a95-4cd4-88d5-0613e0bd7830 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:33.062709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk 1073741824" returned: 0 in 0.074s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:33.063082 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.066160 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.066567 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:33.066798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.081645 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:33.084595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:33.085227 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:33.086331 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.259s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:33.086431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:33.087183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:18:33.087715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:18:33.095200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('16', '-', '-', 0) found on session 193 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:33.095386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:33.096437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('17', '-', '-', 0) found on session 194 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:33.097435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:33.098223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:18:33.099476 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe35:479e', 'fe80::c045:1bff:fe01:bef'] 
May 13 02:18:33.099648 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:18:33.099753 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:18:33.100036 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:33.100434 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating existing volume attachment record: 53a7dde7-f8fc-428b-9da2-0002d462efbf {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:18:33.113654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 193 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:33.119290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:33.132015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 194 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:33.132015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:33.145431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.172230 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.179016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.112s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:33.179534 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:18:33.179776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:33.211570 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998653828999977 future=<Future at 0x705c6c115b20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:33.222925 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Instance destroyed successfully.
May 13 02:18:33.225712 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'resources' on Instance uuid 11f800e0-bd37-43d5-af19-094d2f69e137 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:33.307077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:33.307488 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Cannot resize image /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:18:33.307921 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:18:33.310410 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Ensure instance console log exists: /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:18:33.310755 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:33.313010 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:33.313151 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:33.333041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-fb74e736-f7eb-44e0-8927-44f4bfa5897d req-4b46b478-accc-470c-8864-ca6ee2b5e826 service nova] Releasing lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:33.333630 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquired lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:33.333698 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:18:33.491262 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.497986 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.501378 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.524929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.530942 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.622081 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.645210 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.646896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.681296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:18:33.681756 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:18:33.681928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:33.733805 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1926886913',display_name='tempest-TestEncryptedCinderVolumes-server-1926886913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1926886913',id=69,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv6lyE8RBf32LlcLfnk1g98yuEnDJJzl84j5plOuXkSdpUXDqd7n7c7DrNG83uBDe2ymt0zGzX/pctFManWJm/FAgw2cHHN75afpRXEBkAxn+5RqJzfUtZ5Vjm8weAb8A==',key_name='tempest-keypair-881113935',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:17:36Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-c99w3mx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c20465c49104552b6af116f9e0c14d5',uuid=11f800e0-bd37-43d5-af19-094d2f69e137,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:18:33.733805 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "address": "fa:16:3e:0b:d1:89", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d53f75-76", "ovs_interfaceid": "f4d53f75-7660-4f0f-a50b-ccf1c69bd38d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:33.733805 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:33.734155 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:18:33.735717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.736089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d53f75-76, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:33.738452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.738452 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:33.739395 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.739617 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea53cd6d-c19d-4296-a194-aee6ca3ff24b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:33.740779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.740779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:33.742986 np0000000663 nova-compute[98103]: INFO os_vif [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d1:89,bridge_name='br-int',has_traffic_filtering=True,id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d53f75-76')
May 13 02:18:33.743301 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Deleting instance files /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137_del
May 13 02:18:33.744068 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Deletion of /opt/stack/data/nova/instances/11f800e0-bd37-43d5-af19-094d2f69e137_del complete
May 13 02:18:33.828663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:18:33.913756 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:18:34.001653 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:34.058010 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:34.204121 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updating instance_info_cache with network_info: [{"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:34.272511 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Took 1.44 seconds to destroy the instance on the hypervisor.
May 13 02:18:34.273134 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:18:34.273494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:18:34.273613 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:18:34.273825 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:34.330037 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:34.706715 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Releasing lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:34.707325 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance network_info: |[{"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:18:34.709926 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Start _get_guest_xml network_info=[{"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:18:34.714161 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:18:34.715343 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1032614051', uuid='bdf01623-8fe4-467f-9589-c5cfd5f45304'), owner=OwnerMeta(userid='4acc4ee8597744baa14224320669fc51', username='tempest-VolumeMultiattachTests-932012962-project-member', projectid='7a3847aeaf9841b199e63d3c1c099c9f', projectname='tempest-VolumeMultiattachTests-932012962'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638714.7149973) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:18:34.717122 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:18:34.717521 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:18:34.718639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:18:34.718814 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:18:34.722127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:18:34.730758 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-753140ca-ecd3-4ae2-835e-6a78dc4d2692 req-46b1c0f3-275f-4d15-babe-a786697a5d8f service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-deleted-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:34.731693 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-753140ca-ecd3-4ae2-835e-6a78dc4d2692 req-46b1c0f3-275f-4d15-babe-a786697a5d8f service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Neutron deleted interface f4d53f75-7660-4f0f-a50b-ccf1c69bd38d; detaching it from the instance and deleting it from the info cache
May 13 02:18:34.733270 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-753140ca-ecd3-4ae2-835e-6a78dc4d2692 req-46b1c0f3-275f-4d15-babe-a786697a5d8f service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:34.737816 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1032614051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-1032614051',id=72,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-25phgjjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=bdf01623-8fe4-467f-9589-c5cfd5f45304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:18:34.738072 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:34.738559 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:34.739500 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'pci_devices' on Instance uuid bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:34.845803 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 3300000000dc83aaa for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:18:34.846190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:34.846429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000000dc83aaa', 'path': '/dev/dm-6', 'multipath_id': '3300000000dc83aaa'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:34.846583 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000dc83aaa', 'path': '/dev/dm-6', 'multipath_id': '3300000000dc83aaa'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:18:34.847225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.165s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:34.847417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:18:34.859944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:34.860457 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:18:34.860866 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:34.862054 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:34.862054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:18:34.862054 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:34.873312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:34.873312 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:34.884153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:18:34.884153 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:34.888916 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c] added
May 13 02:18:34.888916 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:34.888916 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:34.888916 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:34.888916 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:34.888916 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:34.888916 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:34.889142 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:34.889272 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:34.889473 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:34.894973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c] added
May 13 02:18:34.894973 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:18:34.894973 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:34.894973 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:34.894973 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:18:34.894973 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:18:34.894973 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:34.895191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:18:34.895296 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:18:34.895500 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:18:35.105649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:35.105811 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] Acquiring lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:35.105951 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:35.106058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] Lock "11f800e0-bd37-43d5-af19-094d2f69e137-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:35.106189 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] No waiting events found dispatching network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:35.106291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-463b5b22-3061-43a1-afa3-073056aa45f1 req-8f326bc0-26d2-4d69-ad77-5c06a98a6295 service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Received event network-vif-unplugged-f4d53f75-7660-4f0f-a50b-ccf1c69bd38d for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:18:35.163951 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:35.239054 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-753140ca-ecd3-4ae2-835e-6a78dc4d2692 req-46b1c0f3-275f-4d15-babe-a786697a5d8f service nova] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Detach interface failed, port_id=f4d53f75-7660-4f0f-a50b-ccf1c69bd38d, reason: Instance 11f800e0-bd37-43d5-af19-094d2f69e137 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:18:35.241667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] End _get_guest_xml xml=<domain type="qemu">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <uuid>bdf01623-8fe4-467f-9589-c5cfd5f45304</uuid>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <name>instance-00000048</name>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumeMultiattachTests-server-1032614051</nova:name>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:18:34</nova:creationTime>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:user uuid="4acc4ee8597744baa14224320669fc51">tempest-VolumeMultiattachTests-932012962-project-member</nova:user>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:project uuid="7a3847aeaf9841b199e63d3c1c099c9f">tempest-VolumeMultiattachTests-932012962</nova:project>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         <nova:port uuid="6a3f0174-55c0-48be-b997-826d9b9311df">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <system>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="serial">bdf01623-8fe4-467f-9589-c5cfd5f45304</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="uuid">bdf01623-8fe4-467f-9589-c5cfd5f45304</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </system>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <os>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </os>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <features>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </features>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   <devices>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.config"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:d7:4b:6b"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <target dev="tap6a3f0174-55"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </interface>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/console.log" append="off"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </serial>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <video>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </video>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </rng>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:   </devices>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]: </domain>
May 13 02:18:35.241667 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Preparing to wait for external event network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1032614051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-1032614051',id=72,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-25phgjjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=bdf01623-8fe4-467f-9589-c5cfd5f45304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.244389 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.244904 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:18:35.246560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.246560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79e239c8-64bd-5c7f-bcba-025a4d07a389', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.246560 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.246723 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:35.248009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.249626 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.249760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a3f0174-55, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.250026 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a3f0174-55, col_values=(('qos', UUID('1dad28a6-fe3d-49cb-83ad-df66abeab26f')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.250189 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a3f0174-55, col_values=(('external_ids', {'iface-id': '6a3f0174-55c0-48be-b997-826d9b9311df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:4b:6b', 'vm-uuid': 'bdf01623-8fe4-467f-9589-c5cfd5f45304'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.250838 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.251828 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:35.256743 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.257553 np0000000663 nova-compute[98103]: INFO os_vif [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55')
May 13 02:18:35.352408 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-image-snapshot-server-693062471',id=71,image_ref='ba859633-6e08-4224-bbed-16d52ed104ba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfy1ZfLRvIe/SCf2Rx0K+WRlRrMkMoh2irxXEtskN+b7RXhT44ENKvUyhq5j1dAk5c9ErZcV0eJ+q00frFNNsPV2Ik0LyMWkrqYmU63YGRqWKJc5hqj7+0nlpHBB3t8DQ==',key_name='tempest-keypair-1428276892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-9rdl8sxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996194033',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=59751567-2cc2-410c-a5e2-e7c98b6382c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:18:35.352685 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:35.353209 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:35.353712 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 59751567-2cc2-410c-a5e2-e7c98b6382c0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:35.668020 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Took 1.39 seconds to deallocate network for instance.
May 13 02:18:35.856818 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] End _get_guest_xml xml=<domain type="qemu">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <uuid>59751567-2cc2-410c-a5e2-e7c98b6382c0</uuid>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <name>instance-00000047</name>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-693062471</nova:name>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:18:31</nova:creationTime>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:diskFormat>raw</nova:diskFormat>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="img_bdm_v2">True</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid=""/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         <nova:port uuid="2c46fb13-a886-4fa7-b212-f41cd7e567ed">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <system>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="serial">59751567-2cc2-410c-a5e2-e7c98b6382c0</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="uuid">59751567-2cc2-410c-a5e2-e7c98b6382c0</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </system>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <os>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </os>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <features>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </features>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   <devices>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/disk.config"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <alias name="ua-f30d8597-e92b-4e58-9bbc-cf1e9aad4799"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-6"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <serial>f30d8597-e92b-4e58-9bbc-cf1e9aad4799</serial>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </disk>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:92:d2:15"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <target dev="tap2c46fb13-a8"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </interface>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/console.log" append="off"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </serial>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <video>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </video>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </rng>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:   </devices>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]: </domain>
May 13 02:18:35.856818 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:18:35.856818 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Preparing to wait for external event network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-image-snapshot-server-693062471',id=71,image_ref='ba859633-6e08-4224-bbed-16d52ed104ba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfy1ZfLRvIe/SCf2Rx0K+WRlRrMkMoh2irxXEtskN+b7RXhT44ENKvUyhq5j1dAk5c9ErZcV0eJ+q00frFNNsPV2Ik0LyMWkrqYmU63YGRqWKJc5hqj7+0nlpHBB3t8DQ==',key_name='tempest-keypair-1428276892',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-9rdl8sxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996194033',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:18:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=59751567-2cc2-410c-a5e2-e7c98b6382c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:18:35.859373 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:18:35.860476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.860476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.860476 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:18:35.861629 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.861629 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8887e782-6383-5481-843a-fc85db1c1133', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.862652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.862652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:35.868641 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.870964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.870964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c46fb13-a8, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.870964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c46fb13-a8, col_values=(('qos', UUID('948a9c73-4b57-4109-9d3d-16bfd87bbea6')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.870964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c46fb13-a8, col_values=(('external_ids', {'iface-id': '2c46fb13-a886-4fa7-b212-f41cd7e567ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:d2:15', 'vm-uuid': '59751567-2cc2-410c-a5e2-e7c98b6382c0'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:18:35.872431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.872431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:18:35.882732 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.883206 np0000000663 nova-compute[98103]: INFO os_vif [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8')
May 13 02:18:35.889862 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:18:35.895851 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:35.904421 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:35.904421 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:18:35.909604 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:18:35.909604 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:35.919853 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:35.925543 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.938910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.944191 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:35.944572 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:35.982017 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:35.993564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260]
May 13 02:18:35.993564 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260] successful.
May 13 02:18:35.993564 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:36.004431 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:36.009790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260]
May 13 02:18:36.009790 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260] successful.
May 13 02:18:36.009790 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:36.024486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.030564 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.030904 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:36.031636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:36.031636 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:36.032378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('18', '-', '-', 0) found on session 195 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:36.032522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:36.045747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 195 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:36.045747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.055760 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f604739b-38fe-4d7b-b666-47bf492c69a8 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:18:36.056062 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:18:36.056310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:36.056310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:18:36.057345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('19', '-', '-', 0) found on session 196 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:18:36.057467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:18:36.073486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 196 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:18:36.073486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:18:36.174784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:36.174784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:36.512385 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:18:36.512589 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:18:36.773675 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:36.773820 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:36.773930 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:d7:4b:6b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:36.774393 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Using config drive
May 13 02:18:36.861907 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:18:37.016556 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:18:37.281485 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:37.401814 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Creating config drive at /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.config
May 13 02:18:37.403158 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:37.403381 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:37.403502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:92:d2:15, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:37.403960 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Using config drive
May 13 02:18:37.408132 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicpazetr {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:37.469304 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpicpazetr" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:37.528500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.354s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:37.602201 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deleted allocations for instance 11f800e0-bd37-43d5-af19-094d2f69e137
May 13 02:18:37.877277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found WWN 3300000004f322818 for multipath device dm-9 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:18:37.877736 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:18:37.877930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== connect_volume: return (4196ms) {'type': 'block', 'scsi_wwn': '3300000004f322818', 'path': '/dev/dm-9', 'multipath_id': '3300000004f322818'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:18:37.878047 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f322818', 'path': '/dev/dm-9', 'multipath_id': '3300000004f322818'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:18:37.889234 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:18:37.901188 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:37.910855 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:37.936798 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.010684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.065538 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Creating config drive at /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/disk.config
May 13 02:18:38.070451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxi26ld8a {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:18:38.087346 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.136437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxi26ld8a" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:18:38.247991 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d7c4372-5a68-4868-aa67-8ca951182879 req-684aa999-8e49-4f3d-8cda-b2f1f48f7b63 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:38.248368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d7c4372-5a68-4868-aa67-8ca951182879 req-684aa999-8e49-4f3d-8cda-b2f1f48f7b63 service nova] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:38.248647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d7c4372-5a68-4868-aa67-8ca951182879 req-684aa999-8e49-4f3d-8cda-b2f1f48f7b63 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:38.248878 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d7c4372-5a68-4868-aa67-8ca951182879 req-684aa999-8e49-4f3d-8cda-b2f1f48f7b63 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:38.249061 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d7c4372-5a68-4868-aa67-8ca951182879 req-684aa999-8e49-4f3d-8cda-b2f1f48f7b63 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Processing event network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:18:38.392832 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attempting to attach volume 5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:18:38.398885 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:   <alias name="ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c"/>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-9"/>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:   <serial>5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c</serial>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]: </disk>
May 13 02:18:38.398885 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:18:38.457470 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0010244140003123903 future=<Future at 0x705c4865f9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:38.457795 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Emitting event <LifecycleEvent: 1778638703.4562836, 3fe8732c-63d4-4c50-950b-791d81d36975 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:38.457986 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:38.458066 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] VM Stopped (Lifecycle Event)
May 13 02:18:38.459082 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.749992182999904 future=<Future at 0x705c6c115b20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:38.459351 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.749727771999915 future=<Future at 0x705c6c115b20 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:38.618383 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-38f8563b-bc4d-4533-bd6e-6ce2463cec21 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "11f800e0-bd37-43d5-af19-094d2f69e137" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.293s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:38.696877 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.715869 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.718288 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.754692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:18:38.755169 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638718.754785, bdf01623-8fe4-467f-9589-c5cfd5f45304 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:38.755363 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] VM Started (Lifecycle Event)
May 13 02:18:38.759179 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:18:38.765265 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance spawned successfully.
May 13 02:18:38.768538 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:18:38.823915 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.831066 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.832680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:38.870188 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3913eee-9138-4153-8b79-55746d760220 req-66b80507-c2b3-4d2e-bffa-97ebf2818de2 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:38.870405 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3913eee-9138-4153-8b79-55746d760220 req-66b80507-c2b3-4d2e-bffa-97ebf2818de2 service nova] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:38.870615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3913eee-9138-4153-8b79-55746d760220 req-66b80507-c2b3-4d2e-bffa-97ebf2818de2 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:38.870765 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3913eee-9138-4153-8b79-55746d760220 req-66b80507-c2b3-4d2e-bffa-97ebf2818de2 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:38.870919 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3913eee-9138-4153-8b79-55746d760220 req-66b80507-c2b3-4d2e-bffa-97ebf2818de2 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Processing event network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:18:38.961067 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 3fe8732c-63d4-4c50-950b-791d81d36975] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:39.260374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:39.269206 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:39.275059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.275188 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.275515 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.275759 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.275990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.276284 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.628530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:18:39.631281 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:18:39.634661 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance spawned successfully.
May 13 02:18:39.634986 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:18:39.637989 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.638292 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:18:39.767936 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:18:39.768191 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638719.7680054, bdf01623-8fe4-467f-9589-c5cfd5f45304 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:39.768311 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] VM Paused (Lifecycle Event)
May 13 02:18:39.780644 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Took 7.03 seconds to spawn the instance on the hypervisor.
May 13 02:18:39.780766 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:40.103676 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:40.104012 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:40.104012 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:18:40.104059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No VIF found with MAC fa:16:3e:35:47:9e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:18:40.142970 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Took 8.37 seconds to spawn the instance on the hypervisor.
May 13 02:18:40.143154 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:40.270774 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:40.273887 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638720.273623, bdf01623-8fe4-467f-9589-c5cfd5f45304 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:40.274021 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] VM Resumed (Lifecycle Event)
May 13 02:18:40.288805 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Took 13.63 seconds to build instance.
May 13 02:18:40.313971 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:40.314454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:40.315466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:40.315620 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:40.315769 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] No waiting events found dispatching network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:40.315897 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-297d688f-cb66-4af2-b74a-105c6c16c6e7 req-eaa922b6-0fa1-4d6a-b6b1-7bb42cfec826 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received unexpected event network-vif-plugged-6a3f0174-55c0-48be-b997-826d9b9311df for instance with vm_state active and task_state None.
May 13 02:18:40.651370 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Took 18.56 seconds to build instance.
May 13 02:18:40.776405 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:40.778546 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:40.790328 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.135s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:40.871731 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:40.942729 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:40.942914 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:18:40.943077 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:18:40.943216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:40.943385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] No waiting events found dispatching network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:18:40.943508 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-ef66bd49-4031-4c7c-8124-43b4dcaceee3 req-d6e6733b-228a-455d-8f90-1fcda68d7f79 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received unexpected event network-vif-plugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed for instance with vm_state active and task_state None.
May 13 02:18:40.995682 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:41.154454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3634bcf7-8276-4651-8f4d-968b3e6fac42 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.070s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:41.282763 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638721.2811055, 59751567-2cc2-410c-a5e2-e7c98b6382c0 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:41.282763 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] VM Started (Lifecycle Event)
May 13 02:18:41.636076 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-changed-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:41.636247 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Refreshing instance network info cache due to event network-changed-2c46fb13-a886-4fa7-b212-f41cd7e567ed. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:41.636374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] Acquiring lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:41.636481 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] Acquired lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:41.636595 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Refreshing network info cache for port 2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:41.662490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4af7128c-32c7-470e-8114-8d1f56e1f23a tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.750s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:18:41.786417 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:41.791637 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:42.138411 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:42.296412 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638722.2961252, 59751567-2cc2-410c-a5e2-e7c98b6382c0 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:42.296765 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] VM Paused (Lifecycle Event)
May 13 02:18:42.398370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:42.399610 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing instance network info cache due to event network-changed-346253e0-41cf-475d-82d3-9052880cc0c2. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:42.399610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Acquiring lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:42.399610 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Acquired lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:42.400276 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Refreshing network info cache for port 346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:42.502724 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:42.685544 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updated VIF entry in instance network info cache for port 2c46fb13-a886-4fa7-b212-f41cd7e567ed. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:42.685825 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating instance_info_cache with network_info: [{"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:42.799326 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:42.805981 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638722.8056312, 59751567-2cc2-410c-a5e2-e7c98b6382c0 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:42.806173 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] VM Resumed (Lifecycle Event)
May 13 02:18:42.904476 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:43.187877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-547bd8ed-27b2-4fb8-930a-a9920dccff14 req-c418892a-c5d0-4439-9ff1-8770473877ff service nova] Releasing lock "refresh_cache-59751567-2cc2-410c-a5e2-e7c98b6382c0" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:43.227655 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:43.309305 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:43.314975 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:18:43.379204 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updated VIF entry in instance network info cache for port 346253e0-41cf-475d-82d3-9052880cc0c2. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:43.380398 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [{"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:43.882588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Releasing lock "refresh_cache-c19374b4-2270-4a5d-ba5c-251d9c52797e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:43.882588 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-changed-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:43.882588 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Refreshing instance network info cache due to event network-changed-6a3f0174-55c0-48be-b997-826d9b9311df. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:43.882588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Acquiring lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:43.882588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Acquired lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:43.882866 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Refreshing network info cache for port 6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:44.385255 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:44.780300 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:44.925176 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updated VIF entry in instance network info cache for port 6a3f0174-55c0-48be-b997-826d9b9311df. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:44.925500 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updating instance_info_cache with network_info: [{"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:45.043691 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:45.043851 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing instance network info cache due to event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:45.043979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:45.044152 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:45.044303 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:45.427888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-aa911346-1a33-4a65-870c-598dab128a12 req-90773210-9989-4b73-ad21-bfb9cf19d0c6 service nova] Releasing lock "refresh_cache-bdf01623-8fe4-467f-9589-c5cfd5f45304" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:45.546000 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:45.885297 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:45.901050 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:45.996274 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:46.057549 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updated VIF entry in instance network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:46.057798 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:46.559843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ca9f8d4d-76a8-42bf-ade2-4f2fb6f9455f req-ea11f96a-6e3f-41bd-9b61-92222b10de25 service nova] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:46.573364 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:18:46.573530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing instance network info cache due to event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:18:46.573695 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:18:46.573794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:18:46.573891 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:18:47.076514 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:47.419008 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:18:47.529213 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updated VIF entry in instance network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:18:47.529950 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:18:48.031069 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-853ab99f-baae-48af-a67a-89b308f905e1 req-8eb07604-b428-4fb2-9065-ce485bdcf342 service nova] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:18:48.209445 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00035341800003152457 future=<Future at 0x705c6c115b20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:48.209647 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:18:48.209923 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638713.2089458, 11f800e0-bd37-43d5-af19-094d2f69e137 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:18:48.210268 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] VM Stopped (Lifecycle Event)
May 13 02:18:48.712739 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-624c0375-b076-4018-b50c-81b802b6fff6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 11f800e0-bd37-43d5-af19-094d2f69e137] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:18:50.886871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:51.006569 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:55.903087 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:56.007570 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:56.977272 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:18:58.593417 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:00.237582 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:00.237933 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:00.739677 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:19:00.904716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:01.008166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:01.302595 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:01.302964 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:01.307598 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:19:01.307796 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Claim successful on node np0000000663
May 13 02:19:01.326601 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:01.351760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:01.351920 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:01.352145 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Rebooting instance
May 13 02:19:01.908605 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:01.908737 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:01.908899 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:19:02.410859 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:02.627450 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:02.627450 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:02.680904 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:02.736166 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:02.860552 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:03.130947 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:03.362312 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:03.637183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.334s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:03.637781 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:19:03.866072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:04.143710 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:19:04.143938 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:19:04.144256 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:04.144538 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:04.230957 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c20465c49104552b6af116f9e0c14d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfe4c819c84128b0149ebe05ecf5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:19:04.649849 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:19:04.779708 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Successfully created port: e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:19:04.904823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:04.908112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:04.934565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:04.939577 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:04.963480 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.154403 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:19:05.253072 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99969867100026 future=<Future at 0x705c8cd439e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:05.253959 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998679466999874 future=<Future at 0x705c8cd439e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:05.254276 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99835576500027 future=<Future at 0x705c8cd439e0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:05.255124 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance destroyed successfully.
May 13 02:19:05.256292 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'resources' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:05.290732 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Successfully updated port: e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:19:05.347724 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-changed-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:05.348984 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Refreshing instance network info cache due to event network-changed-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:05.349172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] Acquiring lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:05.349285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] Acquired lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:05.349481 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Refreshing network info cache for port e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:05.660269 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Booting with volume 21152699-9371-476e-8c1b-eacaf7328d0e at /dev/vda
May 13 02:19:05.721964 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:05.738576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:19:05.758358 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:27Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:19:04Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:05.758577 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:05.759415 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:05.759415 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:05.761004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.764803 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1effd6a6-38, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:05.772074 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.777055 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:05.778044 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.778218 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a257c1a2-2bac-44fe-8241-3df40fe7dfd4) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:05.779299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.779299 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:05.780596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:05.782616 np0000000663 nova-compute[98103]: INFO os_vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38')
May 13 02:19:05.783101 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:05.806923 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:05.822015 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:05.823745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:05.823745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:05.824272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:05.824809 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:05.825069 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:05.851603 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:19:05.851936 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:19:05.853474 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:05.856973 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:05.857498 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:05.857498 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '202')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:05.858029 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '195')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:05.859226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '196')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:05.860190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7f7240>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'): ({'sdn'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:05.860390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Removing multipathed devices sdn, sdm {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:05.860634 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flush multipath device 3300000004f322818 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:05.870913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:19:05.872414 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fed7:4b6b', 'fe80::fc16:3eff:fe92:d215'] 
May 13 02:19:05.872509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:19:05.872587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:19:05.873225 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:05.873225 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating existing volume attachment record: 4e12cd77-55d7-45b0-b149-32fb1e75eb9a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:19:05.896647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:05.947605 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:05.972958 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:19:05.996612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:05.996803 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:05.998846 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:06.010565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:06.015223 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:06.017376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:06.027500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.069349 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260]
May 13 02:19:06.069349 np0000000663 nova-compute[98103]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260] successful.
May 13 02:19:06.069349 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.096070 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.107799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.121333 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:06.158371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260]
May 13 02:19:06.158371 np0000000663 nova-compute[98103]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260] successful.
May 13 02:19:06.158371 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.180161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.180670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:06.180798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== disconnect_volume: return (358ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:06.180846 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:06.187367 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start _get_guest_xml network_info=[{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cf52914-ccbd-4f24-bbbc-332fd218a34e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '2cf52914-ccbd-4f24-bbbc-332fd218a34e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, 'status': 'reserved', 'instance': '75ef4b67-07c0-4399-9d88-d5a6c77207a8', 'attached_at': '', 'detached_at': '', 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'serial': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'}, 'attachment_id': '53a7dde7-f8fc-428b-9da2-0002d462efbf', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:19:06.189580 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:19:06.190841 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='2cf52914-ccbd-4f24-bbbc-332fd218a34e', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1460398376', uuid='75ef4b67-07c0-4399-9d88-d5a6c77207a8'), owner=OwnerMeta(userid='5b8270e949dc4210bf691de82ed07e0d', username='tempest-TestMinimumBasicScenario-1453218982-project-member', projectid='ad986512b43843d28a756102ac971343', projectname='tempest-TestMinimumBasicScenario-1453218982'), image=ImageMeta(id='2cf52914-ccbd-4f24-bbbc-332fd218a34e', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638746.190502) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:19:06.192297 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:19:06.192644 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:19:06.193747 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:19:06.194293 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:19:06.196074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:19:06.196441 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=2cf52914-ccbd-4f24-bbbc-332fd218a34e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:19:06.196622 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:19:06.196744 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:19:06.196897 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:19:06.197009 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:19:06.197152 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:19:06.197353 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:19:06.197490 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:19:06.197661 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:19:06.197752 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:19:06.197900 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:19:06.198147 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'vcpu_model' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:06.625024 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-982161e3-e581-4c67-b08a-1cc9b6dc7167 req-f695dc81-2c91-40a1-8d56-1bb2281975d3 service nova] Releasing lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:06.626080 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquired lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:06.626261 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:19:06.700222 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Object Instance<75ef4b67-07c0-4399-9d88-d5a6c77207a8> lazy-loaded attributes: resources,vcpu_model {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:19:06.712365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:06.812048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:06.812538 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:06.812785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:06.813402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:06.813769 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:19:06.814184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:06.814351 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:06.814963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:06.815180 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:19:06.827910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:06.828687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:06.830558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:06.830775 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:06.832179 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:06.832875 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:06.846504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:06.846504 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.857650 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:06.857650 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.878621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c] added
May 13 02:19:06.878621 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:06.878621 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:06.878621 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:06.878621 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:06.878621 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:06.878621 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.880254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c] added
May 13 02:19:06.880254 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:06.880254 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:06.880254 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:06.880254 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:06.880254 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:06.880254 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:06.880894 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:06.881218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:06.881520 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0488(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:06.881731 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0507(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:06.881909 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:06.882050 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:07.201869 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:19:07.360188 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:07.561506 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating instance_info_cache with network_info: [{"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:07.882416 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:07.883206 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:07.900222 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:07.900222 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:07.902391 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:07.902391 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:07.917433 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:07.926415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:07.942412 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:07.942828 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:07.944687 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:07.945054 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:07.993054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260]
May 13 02:19:07.993054 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260] successful.
May 13 02:19:07.993054 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:08.000654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260]
May 13 02:19:08.000654 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260] successful.
May 13 02:19:08.000654 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:08.004470 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:19:08.005637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:08.006425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:19:08.007724 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Creating image(s)
May 13 02:19:08.007991 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:19:08.008103 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Ensure instance console log exists: /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:19:08.008317 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:08.008460 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:08.009714 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:08.014380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.025620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.026074 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:08.026499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:08.026499 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:08.027952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('18', '-', '-', 0) found on session 203 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:08.028105 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.037929 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:08.038599 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:08.038599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:08.039916 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('19', '-', '-', 0) found on session 204 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:08.040020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:08.051551 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 203 and hctl ['18', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:08.061476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 204 and hctl ['19', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:08.063889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Releasing lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:08.064285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance network_info: |[{"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:19:08.065089 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Start _get_guest_xml network_info=[{"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f8726c6d-901d-40da-b3b3-d66be3b9a5de', 'attached_at': '', 'detached_at': '', 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'serial': '21152699-9371-476e-8c1b-eacaf7328d0e'}, 'attachment_id': '4e12cd77-55d7-45b0-b149-32fb1e75eb9a', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:19:08.074782 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:19:08.075028 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1007430161', uuid='f8726c6d-901d-40da-b3b3-d66be3b9a5de'), owner=OwnerMeta(userid='7c20465c49104552b6af116f9e0c14d5', username='tempest-TestEncryptedCinderVolumes-368552408-project-member', projectid='57dfe4c819c84128b0149ebe05ecf5be', projectname='tempest-TestEncryptedCinderVolumes-368552408'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638748.0747063) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:19:08.078573 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:19:08.078915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:19:08.081310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:19:08.081310 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:19:08.082173 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:19:08.082516 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:19:08.082686 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:19:08.082777 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:19:08.082895 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:19:08.082974 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:19:08.083122 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:19:08.083362 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:19:08.083492 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:19:08.087271 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:19:08.087271 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:19:08.087271 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:19:08.102944 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:19:08.103221 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:08.103347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:09.051962 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 203 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:09.052486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:09.061334 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 204 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:09.061588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:09.830748 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:19:10.779885 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:10.803654 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:10.803891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:10.804062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:10.804483 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:10.804703 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] No waiting events found dispatching network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:10.805570 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-c08e2760-b6e1-439b-b84c-fa52f690f980 req-d7238902-d3e6-40b3-9604-dc461ef749fb service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received unexpected event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b for instance with vm_state building and task_state spawning.
May 13 02:19:10.847374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found WWN 3300000004f322818 for multipath device dm-9 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:19:10.847718 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:10.847943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== connect_volume: return (4033ms) {'type': 'block', 'scsi_wwn': '3300000004f322818', 'path': '/dev/dm-9', 'multipath_id': '3300000004f322818'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:10.848152 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f322818', 'path': '/dev/dm-9', 'multipath_id': '3300000004f322818'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:19:10.850467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.745s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:10.850621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:19:10.865029 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:10.865847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:10.866681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:10.867030 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:10.867518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:10.868164 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:10.882649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:10.882649 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:10.892521 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:10.892521 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:10.904793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e] added
May 13 02:19:10.904793 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:10.904793 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:10.904793 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:10.904793 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:10.904793 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:10.904793 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:10.904951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:10.905184 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:10.905373 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:10.912516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e] added
May 13 02:19:10.912516 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:10.912516 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:10.912516 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:10.912516 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:10.912516 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:10.912516 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:10.912768 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:10.912953 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0459(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:10.913149 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:11.011692 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:11.358170 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:27Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:19:04Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:19:11.358526 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:11.359186 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:11.360251 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'pci_devices' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:11.729013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:11.862688 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Object Instance<75ef4b67-07c0-4399-9d88-d5a6c77207a8> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:19:11.863655 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <uuid>75ef4b67-07c0-4399-9d88-d5a6c77207a8</uuid>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <name>instance-00000046</name>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestMinimumBasicScenario-server-1460398376</nova:name>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:19:06</nova:creationTime>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:image uuid="2cf52914-ccbd-4f24-bbbc-332fd218a34e">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:property name="hw_machine_type">pc</nova:property>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:property name="hw_video_model">virtio</nova:property>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:user uuid="5b8270e949dc4210bf691de82ed07e0d">tempest-TestMinimumBasicScenario-1453218982-project-member</nova:user>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:project uuid="ad986512b43843d28a756102ac971343">tempest-TestMinimumBasicScenario-1453218982</nova:project>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="2cf52914-ccbd-4f24-bbbc-332fd218a34e"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         <nova:port uuid="1effd6a6-381d-4c92-b42b-ca4eb0f6200f">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <system>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="serial">75ef4b67-07c0-4399-9d88-d5a6c77207a8</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="uuid">75ef4b67-07c0-4399-9d88-d5a6c77207a8</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </system>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <os>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </os>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <features>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </features>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   <devices>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk.config"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <alias name="ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-9"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <serial>5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c</serial>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:35:47:9e"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <target dev="tap1effd6a6-38"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </interface>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/console.log" append="off"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </serial>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <video>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </video>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </rng>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:   </devices>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]: </domain>
May 13 02:19:11.863655 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:19:11.866302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:11.906669 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:11.913716 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:11.925956 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:11.925956 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:11.932449 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:11.932449 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:11.945527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:11.951654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:11.973950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.975211 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.975800 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:11.976271 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.998143 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:11.998667 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:12.057487 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.50.100,3260]
May 13 02:19:12.057487 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.50.100,3260] successful.
May 13 02:19:12.057487 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:12.066075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.40.100,3260]
May 13 02:19:12.066075 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.40.100,3260] successful.
May 13 02:19:12.066075 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:12.077527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:12.081904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:12.082402 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:12.086110 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'trusted_certs' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:12.086110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.102872 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.103542 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:12.104002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.236s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:12.104002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:12.105480 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('20', '-', '-', 0) found on session 205 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:12.105626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.110987 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [202] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:12.111369 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:12.111618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.245s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:12.111618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:12.112966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('21', '-', '-', 0) found on session 206 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:12.113081 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:12.129118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 206 and hctl ['21', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:12.133839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 205 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:12.133839 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:12.587630 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Object Instance<75ef4b67-07c0-4399-9d88-d5a6c77207a8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:19:12.588018 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:12.690026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4cfb49569271a42f4c26ca77b4d2c93a5da7559c --force-share --output=json" returned: 0 in 0.102s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:12.690477 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:19:12.690746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:12.785825 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:12.785987 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Cannot resize image /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:19:12.786403 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'migration_context' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:12.880379 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:12.881488 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:12.882165 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:12.882267 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:12.882473 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:12.882666 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received unexpected event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with vm_state active and task_state reboot_started_hard.
May 13 02:19:12.882817 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:12.882981 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:12.883367 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:12.883477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:12.883862 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:12.884048 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-bc81d5d4-de59-4db8-a025-ab856f39042b req-09b8e093-82fe-4363-9d79-4e9f7576cf7b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received unexpected event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with vm_state active and task_state reboot_started_hard.
May 13 02:19:13.129647 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 206 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:13.129911 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:13.292652 np0000000663 nova-compute[98103]: DEBUG nova.objects.base [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Object Instance<75ef4b67-07c0-4399-9d88-d5a6c77207a8> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98103) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 13 02:19:13.292652 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:27Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:04Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:19:13.292652 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:13.292652 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:13.292652 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:19:13.293046 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.293473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:13.293826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:19:13.294721 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.294918 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0094132b-4af9-5dee-b926-d23b3a5775f7', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:13.308189 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.308280 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:13.310029 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.310247 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1effd6a6-38, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:13.310638 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1effd6a6-38, col_values=(('qos', UUID('602a7a39-be5b-4675-bffc-9da67d8dfd88')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:13.310826 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1effd6a6-38, col_values=(('external_ids', {'iface-id': '1effd6a6-381d-4c92-b42b-ca4eb0f6200f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:47:9e', 'vm-uuid': '75ef4b67-07c0-4399-9d88-d5a6c77207a8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:13.311753 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.313340 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:13.317343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.320911 np0000000663 nova-compute[98103]: INFO os_vif [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38')
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496124 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.496494 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:19:13.496494 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:13.527545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.818139 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.838064 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.905027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Found WWN 330000000da5624c1 for multipath device dm-10 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:19:13.905533 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.057s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:13.906848 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== connect_volume: return (5803ms) {'type': 'block', 'scsi_wwn': '330000000da5624c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000da5624c1'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:13.907116 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000da5624c1', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000da5624c1'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:19:13.961018 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'f8726c6d-901d-40da-b3b3-d66be3b9a5de', 'attached_at': '', 'detached_at': '', 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'serial': '21152699-9371-476e-8c1b-eacaf7328d0e'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:19:13.961510 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:19:13.961717 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:19:13.961897 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:19:13.965847 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:13.982695 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:19:13.982695 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:19:13.982695 np0000000663 nova-compute[98103]:     <volume>21152699-9371-476e-8c1b-eacaf7328d0e</volume>
May 13 02:19:13.982695 np0000000663 nova-compute[98103]:   </usage>
May 13 02:19:13.982695 np0000000663 nova-compute[98103]: </secret>
May 13 02:19:13.982695 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:19:14.008054 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:14.008377 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:14.008585 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:14.008788 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:19:14.231184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:14.232760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:14.239163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:14.264985 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:14.498843 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1007430161',display_name='tempest-TestEncryptedCinderVolumes-server-1007430161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1007430161',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-y20dpla3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:05Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=f8726c6d-901d-40da-b3b3-d66be3b9a5de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:19:14.499121 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:14.499823 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:14.501249 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'pci_devices' on Instance uuid f8726c6d-901d-40da-b3b3-d66be3b9a5de {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:14.765030 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 75ef4b67-07c0-4399-9d88-d5a6c77207a8 due to new event <LifecycleEvent: 1778638754.7646317, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:19:14.765261 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638754.7646317, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:14.765490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Resumed (Lifecycle Event)
May 13 02:19:14.766682 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance event wait completed in 0 seconds for  {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:19:14.769802 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance rebooted successfully.
May 13 02:19:14.935317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:14.935683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:14.935683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received unexpected event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with vm_state active and task_state reboot_started_hard.
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:14.936512 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:14.936812 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-7ae6dc20-0a7d-483d-9951-32a5f930d283 req-a6a4ca7f-49a9-4623-a4f4-23a5901d1eb7 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received unexpected event network-vif-plugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with vm_state active and task_state reboot_started_hard.
May 13 02:19:15.004403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] End _get_guest_xml xml=<domain type="qemu">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <uuid>f8726c6d-901d-40da-b3b3-d66be3b9a5de</uuid>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <name>instance-00000049</name>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1007430161</nova:name>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:19:08</nova:creationTime>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:user uuid="7c20465c49104552b6af116f9e0c14d5">tempest-TestEncryptedCinderVolumes-368552408-project-member</nova:user>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:project uuid="57dfe4c819c84128b0149ebe05ecf5be">tempest-TestEncryptedCinderVolumes-368552408</nova:project>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <nova:port uuid="e1cbab4e-7879-4ec6-b7ba-c72d005ce76b">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <system>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="serial">f8726c6d-901d-40da-b3b3-d66be3b9a5de</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="uuid">f8726c6d-901d-40da-b3b3-d66be3b9a5de</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </system>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <os>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </os>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <features>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </features>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   <devices>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/disk.config"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <alias name="ua-21152699-9371-476e-8c1b-eacaf7328d0e"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <serial>21152699-9371-476e-8c1b-eacaf7328d0e</serial>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <encryption format="luks">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:         <secret type="passphrase" uuid="7b398701-744b-4661-9dc5-ec9eb4b57bb1"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       </encryption>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:12:4c:f7"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <target dev="tape1cbab4e-78"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </interface>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/console.log" append="off"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </serial>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <video>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </video>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </rng>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:   </devices>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]: </domain>
May 13 02:19:15.004403 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Preparing to wait for external event network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1007430161',display_name='tempest-TestEncryptedCinderVolumes-server-1007430161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1007430161',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-y20dpla3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:05Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=f8726c6d-901d-40da-b3b3-d66be3b9a5de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:15.008597 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:19:15.009792 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.009792 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a116b980-15c2-5ef4-a03d-39ace49a06ed', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:15.014843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.014843 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:15.017598 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.018075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1cbab4e-78, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:15.018075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1cbab4e-78, col_values=(('qos', UUID('8cc01138-4cf8-4496-8e8b-1999f5700bbe')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:15.018184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1cbab4e-78, col_values=(('external_ids', {'iface-id': 'e1cbab4e-7879-4ec6-b7ba-c72d005ce76b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:4c:f7', 'vm-uuid': 'f8726c6d-901d-40da-b3b3-d66be3b9a5de'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:15.019188 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.020248 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:15.025313 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:15.026203 np0000000663 nova-compute[98103]: INFO os_vif [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78')
May 13 02:19:15.108442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.208307 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.208740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.270617 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:15.281437 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:15.301386 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.301683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.304172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.306293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.393131 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.393570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.481938 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.482468 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.482631 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-5 (vdc) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.482775 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vdd) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.488348 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-6 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:19:15.490269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.594978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.598183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.692245 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.698614 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:19:15.700323 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:15.750172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:15.751252 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12381MB free_disk=72.62373352050781GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:19:15.751681 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:15.752119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:15.784411 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 13 02:19:15.784654 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638755.7844684, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:15.784760 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Started (Lifecycle Event)
May 13 02:19:16.013705 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:16.286290 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:16.288790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:16.288790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:16.288790 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No VIF found with MAC fa:16:3e:35:47:9e, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:19:16.288790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:16.288790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:16.295123 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:16.550855 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:16.550969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:16.551013 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No VIF found with MAC fa:16:3e:12:4c:f7, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:19:16.551539 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Using config drive
May 13 02:19:16.799647 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 13 02:19:16.800128 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-4399a115-f007-4161-8d0d-04d853af547c tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 15.448s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance c19374b4-2270-4a5d-ba5c-251d9c52797e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 4c853575-60b7-45b0-9260-7d33471ac9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 59751567-2cc2-410c-a5e2-e7c98b6382c0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance bdf01623-8fe4-467f-9589-c5cfd5f45304 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance f8726c6d-901d-40da-b3b3-d66be3b9a5de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:19:16.846959 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:19:15 up 43 min,  2 users,  load average: 5.49, 6.47, 5.30\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '6', 'num_proj_7a3847aeaf9841b199e63d3c1c099c9f': '2', 'io_workload': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '2', 'num_task_reboot_started_hard': '1', 'num_proj_ad986512b43843d28a756102ac971343': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_57dfe4c819c84128b0149ebe05ecf5be': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:19:17.058030 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:17.171943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:17.171943 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:17.203107 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Creating config drive at /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/disk.config
May 13 02:19:17.206049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy0vl9j95 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:17.264701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpy0vl9j95" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:17.675183 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:17.683935 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:17.698716 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:17.702776 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:17.800772 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:17.858941 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e9e4faec-d7ca-422b-b2a1-8241acb915a0 req-f03b87e6-40d1-4369-9ac4-4b3b138c1c51 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:17.859259 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9e4faec-d7ca-422b-b2a1-8241acb915a0 req-f03b87e6-40d1-4369-9ac4-4b3b138c1c51 service nova] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:17.860649 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9e4faec-d7ca-422b-b2a1-8241acb915a0 req-f03b87e6-40d1-4369-9ac4-4b3b138c1c51 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:17.860860 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9e4faec-d7ca-422b-b2a1-8241acb915a0 req-f03b87e6-40d1-4369-9ac4-4b3b138c1c51 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:17.861048 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e9e4faec-d7ca-422b-b2a1-8241acb915a0 req-f03b87e6-40d1-4369-9ac4-4b3b138c1c51 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Processing event network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.448s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.68 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:18.885303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:18.924678 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:19.393274 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638759.3927338, f8726c6d-901d-40da-b3b3-d66be3b9a5de => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:19.393848 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:19:19.394148 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] VM Started (Lifecycle Event)
May 13 02:19:19.396280 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:19:19.399112 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance spawned successfully.
May 13 02:19:19.399470 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:19:19.898134 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:19.908154 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.908358 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.908673 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.909330 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.909330 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.909601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:19.912513 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:19.932411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] No waiting events found dispatching network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:19.941114 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-817e3f01-c01b-4b07-9177-b1c5426600f8 req-032588e3-3c55-42e2-b91f-ea963c1110c9 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received unexpected event network-vif-plugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b for instance with vm_state building and task_state spawning.
May 13 02:19:20.019068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:20.253021 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00038370899983419804 future=<Future at 0x705c8cd439e0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:20.253090 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:20.415656 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Took 12.41 seconds to spawn the instance on the hypervisor.
May 13 02:19:20.415933 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:20.416735 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:19:20.417104 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638760.4168673, f8726c6d-901d-40da-b3b3-d66be3b9a5de => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:20.417308 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] VM Paused (Lifecycle Event)
May 13 02:19:20.920007 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:20.926947 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638760.9266398, f8726c6d-901d-40da-b3b3-d66be3b9a5de => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:20.927068 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] VM Resumed (Lifecycle Event)
May 13 02:19:20.931603 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Took 19.69 seconds to build instance.
May 13 02:19:21.027473 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:21.027672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:21.028006 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Attaching volume bd72a680-95f9-4bf0-b217-04618c8cf4fa to /dev/vdb
May 13 02:19:21.030486 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:21.080371 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:21.099164 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:19:21.123892 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:21.172471 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:19:21.172741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:19:21.186540 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:19:21.188670 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fed7:4b6b', 'fe80::fc16:3eff:fe92:d215', 'fe80::fc16:3eff:fe35:479e', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fe12:4cf7', 'fe80::9cba:3bff:fe2a:a965'] 
May 13 02:19:21.188670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:19:21.188670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:19:21.188879 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:21.189552 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updating existing volume attachment record: 77db4a95-8dbd-4207-a38c-570eb1695d3d {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:19:21.432351 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:21.433451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-52fb126a-884e-4d3f-87a6-3f8427f61cdc tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.195s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:21.437363 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:21.751218 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:19:21.751585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:21.752536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:21.753438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:21.753438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:19:21.767463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:21.768103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:21.768663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:21.768876 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:21.769429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:21.769655 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:21.781890 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:21.781890 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.startup = automatic
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.scan = manual
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:21.795268 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:21.795268 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:21.797944 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:21.808338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.821583 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.822002 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:21.822002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.053s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:21.822432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:21.822938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('13', '0', '0', 0) found on session 189 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:21.823035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.834269 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:21.834727 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:21.834727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:21.835195 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:21.835747 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 189 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:21.835905 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:21.836629 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('12', '0', '0', 0) found on session 188 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:21.836764 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:21.846430 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 188 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:21.846550 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:22.133818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:22.135509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:22.540072 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-changed-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:22.540229 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Refreshing instance network info cache due to event network-changed-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:22.540388 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] Acquiring lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:22.540464 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] Acquired lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:22.540584 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Refreshing network info cache for port e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:22.639125 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:19:22.769719 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:19:23.043215 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:23.186969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:23.186969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:23.189844 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:19:23.190046 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Claim successful on node np0000000663
May 13 02:19:23.326434 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:23.450342 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updated VIF entry in instance network info cache for port e1cbab4e-7879-4ec6-b7ba-c72d005ce76b. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:19:23.450605 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating instance_info_cache with network_info: [{"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:23.784137 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found WWN 330000000ed3ff9d0 for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:19:23.784402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.032s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:23.784554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '330000000ed3ff9d0', 'path': '/dev/dm-4', 'multipath_id': '330000000ed3ff9d0'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:23.784666 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ed3ff9d0', 'path': '/dev/dm-4', 'multipath_id': '330000000ed3ff9d0'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:19:23.787758 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:23.952593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-36363193-7545-4bb0-9966-56619cdda7e0 req-a3e61b20-872e-41d1-bb15-69f2e00c0c3e service nova] Releasing lock "refresh_cache-f8726c6d-901d-40da-b3b3-d66be3b9a5de" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:24.251578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:24.251578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:24.251578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:24.251578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:24.251578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:24.253169 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Terminating instance
May 13 02:19:24.290232 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Attempting to attach volume bd72a680-95f9-4bf0-b217-04618c8cf4fa with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:19:24.291776 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:24.291776 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:19:24.538412 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:24.538642 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:24.757525 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:19:24.772650 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:24.775957 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:24.800050 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:24.903893 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:24.911135 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:24.926779 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:24.930728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:24.930728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:24.930728 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:24.930728 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] No waiting events found dispatching network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:24.930728 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-73f43526-5fb0-409d-b9b8-a855d332182d req-10f29def-2edb-4eee-bab7-542c1c1819b4 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:25.033409 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.040916 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:25.103087 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999684964000153 future=<Future at 0x705c6c69d0a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:25.103087 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999185205999765 future=<Future at 0x705c6c69d0a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:25.103087 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.998965448000035 future=<Future at 0x705c6c69d0a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:25.108347 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Instance destroyed successfully.
May 13 02:19:25.109010 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 59751567-2cc2-410c-a5e2-e7c98b6382c0 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:25.547407 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.361s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:25.547887 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:19:25.611621 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-693062471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-image-snapshot-server-693062471',id=71,image_ref='ba859633-6e08-4224-bbed-16d52ed104ba',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfy1ZfLRvIe/SCf2Rx0K+WRlRrMkMoh2irxXEtskN+b7RXhT44ENKvUyhq5j1dAk5c9ErZcV0eJ+q00frFNNsPV2Ik0LyMWkrqYmU63YGRqWKJc5hqj7+0nlpHBB3t8DQ==',key_name='tempest-keypair-1428276892',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:40Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-9rdl8sxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1996194033',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=59751567-2cc2-410c-a5e2-e7c98b6382c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:25.612026 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "address": "fa:16:3e:92:d2:15", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c46fb13-a8", "ovs_interfaceid": "2c46fb13-a886-4fa7-b212-f41cd7e567ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:25.612477 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:25.612677 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:25.613806 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.613988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c46fb13-a8, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:25.614867 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.615634 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:25.615812 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.616432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.616562 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=948a9c73-4b57-4109-9d3d-16bfd87bbea6) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:25.616899 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.617364 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:25.617563 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:25.619602 np0000000663 nova-compute[98103]: INFO os_vif [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=2c46fb13-a886-4fa7-b212-f41cd7e567ed,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c46fb13-a8')
May 13 02:19:25.621258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:25.621502 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:25.621654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:25.621909 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:25.622160 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:25.622297 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:25.650588 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799 (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:25.651072 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '194'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:25.651072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '194')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:25.651924 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799', '193')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:25.652826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6aba60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:25.652993 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdk, sdl {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:25.653328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 3300000000dc83aaa {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:25.709324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:25.749327 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:25.785365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:25.785497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdk, sdl have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:25.786673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdk', 'sdl'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:25.796134 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdk', 'sdl'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:25.796332 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:25.810122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.851002 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.40.100,3260]
May 13 02:19:25.851002 np0000000663 nova-compute[98103]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.40.100,3260] successful.
May 13 02:19:25.851002 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.871415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.882577 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.918724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.50.100,3260]
May 13 02:19:25.918724 np0000000663 nova-compute[98103]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-f30d8597-e92b-4e58-9bbc-cf1e9aad4799, portal: 192.168.50.100,3260] successful.
May 13 02:19:25.918724 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.939438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:25.939674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:25.939826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (318ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:25.939977 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:25.940360 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Deleting instance files /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0_del
May 13 02:19:25.940945 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:25.941074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:25.941204 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:25.941331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:d7:4b:6b, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:19:25.943794 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Deletion of /opt/stack/data/nova/instances/59751567-2cc2-410c-a5e2-e7c98b6382c0_del complete
May 13 02:19:26.033979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:26.052832 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:19:26.053047 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:19:26.053377 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:26.053566 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:26.120921 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba655df8e5e48b4b75b0aa4d9c5a68c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '751d97a0dee94850a5b3deb439648aa6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:19:26.464566 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Took 1.71 seconds to destroy the instance on the hypervisor.
May 13 02:19:26.464831 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:19:26.465023 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:19:26.465115 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:19:26.465325 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:26.525593 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:26.558551 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:19:26.610283 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Successfully created port: a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:19:27.001026 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-df0cf00b-0573-4719-9ef0-ef1da2751b5e req-e1a49ab1-64ac-4aee-b145-cf8bbed9ecda service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-deleted-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:27.003782 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-df0cf00b-0573-4719-9ef0-ef1da2751b5e req-e1a49ab1-64ac-4aee-b145-cf8bbed9ecda service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Neutron deleted interface 2c46fb13-a886-4fa7-b212-f41cd7e567ed; detaching it from the instance and deleting it from the info cache
May 13 02:19:27.003782 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-df0cf00b-0573-4719-9ef0-ef1da2751b5e req-e1a49ab1-64ac-4aee-b145-cf8bbed9ecda service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:27.007443 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:27.008583 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] Acquiring lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:27.009746 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:27.009930 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:27.010649 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] No waiting events found dispatching network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:27.011576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-807637ed-4140-408c-b01b-f358d103a529 req-f83c9c83-cea5-4a9b-ba4e-b0e3669377b8 service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Received event network-vif-unplugged-2c46fb13-a886-4fa7-b212-f41cd7e567ed for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:27.110859 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Successfully updated port: a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:19:27.435921 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:27.509355 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-df0cf00b-0573-4719-9ef0-ef1da2751b5e req-e1a49ab1-64ac-4aee-b145-cf8bbed9ecda service nova] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Detach interface failed, port_id=2c46fb13-a886-4fa7-b212-f41cd7e567ed, reason: Instance 59751567-2cc2-410c-a5e2-e7c98b6382c0 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:19:27.512622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-fb0d949e-9f2e-4705-8429-2029c3dd1d80 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.485s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:27.569113 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:19:27.613345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:27.613532 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquired lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:27.613532 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:19:27.937766 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Took 1.47 seconds to deallocate network for instance.
May 13 02:19:28.072747 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Booting with volume 77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c at /dev/vdb
May 13 02:19:28.106354 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:28.117703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:19:28.140565 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:28.183522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:19:28.184614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:19:28.192787 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:19:28.198175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:19:28.199261 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fee8:eee7', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fed7:4b6b', 'fe80::fc16:3eff:fe35:479e', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fe12:4cf7', 'fe80::9cba:3bff:fe2a:a965'] 
May 13 02:19:28.199392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:19:28.199494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:19:28.199878 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:28.200042 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating existing volume attachment record: ed402843-3b50-4d3e-b1eb-1cc57b5f3af0 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:19:28.363484 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:28.479889 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Took 0.54 seconds to detach 1 volumes for instance.
May 13 02:19:28.482958 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Deleting volume: f30d8597-e92b-4e58-9bbc-cf1e9aad4799 {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:19:28.507116 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating instance_info_cache with network_info: [{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:29.009506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Releasing lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:29.009506 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Instance network_info: |[{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:19:29.023997 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:29.024314 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:29.066643 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-changed-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:29.067131 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Refreshing instance network info cache due to event network-changed-a162fb93-eb04-4d87-bd01-170f5dc59897. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:29.067323 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] Acquiring lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:29.067452 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] Acquired lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:29.067611 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Refreshing network info cache for port a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:29.178058 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:29.178462 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:29.389949 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:29.390156 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:29.572883 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:29.683063 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Detaching volume bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:19:29.731621 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Attempting to driver detach volume bd72a680-95f9-4bf0-b217-04618c8cf4fa from mountpoint /dev/vdb
May 13 02:19:29.738069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:29.739269 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:29.739383 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Attempting to detach device vdb from instance bdf01623-8fe4-467f-9589-c5cfd5f45304 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:19:29.739639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:29.739639 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:29.744804 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance bdf01623-8fe4-467f-9589-c5cfd5f45304 from the persistent domain config.
May 13 02:19:29.745026 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] (1/8): Attempting to detach device vdb with device alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa from instance bdf01623-8fe4-467f-9589-c5cfd5f45304 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:19:29.745282 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:29.745282 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:29.854550 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:29.892689 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:29.982393 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updated VIF entry in instance network info cache for port a162fb93-eb04-4d87-bd01-170f5dc59897. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:19:29.982767 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating instance_info_cache with network_info: [{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:30.256112 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638770.2552736, bdf01623-8fe4-467f-9589-c5cfd5f45304 => ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:19:30.256488 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa for instance bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:19:30.258792 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance bdf01623-8fe4-467f-9589-c5cfd5f45304 from the live domain config.
May 13 02:19:30.307980 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:19:30.309301 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:19:30.309561 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Creating image(s)
May 13 02:19:30.310074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:30.310293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:30.310781 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:30.311528 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:19:30.315319 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:19:30.316558 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:30.402190 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.378s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:30.409902 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:30.410353 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:30.410803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:30.411279 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:19:30.414953 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:19:30.415431 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:30.472234 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 59751567-2cc2-410c-a5e2-e7c98b6382c0
May 13 02:19:30.485439 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3fef1c22-740b-48a8-906a-63169c7696dd req-862fd693-6fa9-4430-b138-b28103f5f479 service nova] Releasing lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:30.510799 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:30.511241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:30.564895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk 1073741824" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:30.565466 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:30.565874 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:30.617909 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:30.670672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.105s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:30.671071 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:19:30.671362 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:30.766442 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:30.766926 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Cannot resize image /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:19:30.767597 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:19:30.767754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Ensure instance console log exists: /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:19:30.768031 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:30.768331 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:30.768532 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:30.771980 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Start _get_guest_xml network_info=[{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': -1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '34fc8c7d-d5ce-4052-9dab-27f6741dd3f3', 'attached_at': '', 'detached_at': '', 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'serial': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'}, 'attachment_id': 'ed402843-3b50-4d3e-b1eb-1cc57b5f3af0', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:19:30.778238 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:19:30.780390 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-instance-1455047475', uuid='34fc8c7d-d5ce-4052-9dab-27f6741dd3f3'), owner=OwnerMeta(userid='fba655df8e5e48b4b75b0aa4d9c5a68c', username='tempest-VolumesBackupsTest-645293351-project-member', projectid='751d97a0dee94850a5b3deb439648aa6', projectname='tempest-VolumesBackupsTest-645293351'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638770.7798877) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:19:30.782124 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:19:30.782587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:19:30.783990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:19:30.784215 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:19:30.785605 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:19:30.785979 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:19:30.786217 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:19:30.786376 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:19:30.786538 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:19:30.786664 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:19:30.786838 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:19:30.787022 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:19:30.787208 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:19:30.787378 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:19:30.787532 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:19:30.787881 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:19:30.797961 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Detected multiple connections on this host for volume: bd72a680-95f9-4bf0-b217-04618c8cf4fa, skipping target disconnect.
May 13 02:19:30.807542 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:19:30.807542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:30.807542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:30.807542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:30.807542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:19:30.823593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:30.824246 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:30.824584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:30.824770 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:30.827860 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:30.828069 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:30.837673 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:30.837673 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:30.842302 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:30.842302 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:30.851435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c] added
May 13 02:19:30.851435 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:30.851435 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:30.851435 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:30.851435 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:30.851435 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:30.851435 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:30.851630 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:30.851784 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:30.851946 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:30.855200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c] added
May 13 02:19:30.855200 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:30.855200 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:30.855200 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:30.855200 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:30.855200 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:30.855200 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:30.855437 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:30.855576 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:30.855734 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:31.035150 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:31.349970 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:31.481308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-90bc90c5-aa5f-4aae-9394-4f1c3121e5bf tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "59751567-2cc2-410c-a5e2-e7c98b6382c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.230s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:31.853583 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:31.856111 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:31.869438 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:31.869438 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:31.880438 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:31.880438 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.886792 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.894512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.907808 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.908268 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.928708 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.928992 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:31.955767 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.40.100,3260]
May 13 02:19:31.955767 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.40.100,3260] successful.
May 13 02:19:31.955767 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.968015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.987115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.50.100,3260]
May 13 02:19:31.987115 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.50.100,3260] successful.
May 13 02:19:31.987115 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:31.990818 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:31.993175 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] HCTL ('11', '-', '-', 0) found on session 207 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:31.993175 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:31.997106 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:32.012246 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Searching for a device in session 207 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:32.012383 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:32.022522 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:32.022845 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:32.023115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:32.023115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:32.024440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] HCTL ('16', '-', '-', 0) found on session 208 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:32.024538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:32.045542 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Searching for a device in session 208 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:32.045707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:32.357114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d21f0b1-86a3-43d5-9d84-4484404fc644 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.178s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:32.439472 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:32.439641 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:32.439839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:32.440026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:32.440220 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:32.442468 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Terminating instance
May 13 02:19:32.825458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:19:32.945961 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:19:32.985021 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:32.985644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.009719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.133382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.140315 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.157604 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:33.157877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:33.157877 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:33.158053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:33.158205 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] No waiting events found dispatching network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:33.159143 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-40c0c815-5140-4d43-a364-0d30da0e9832 req-6b38b422-9f42-43ee-a343-1f2aee1bbed5 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:33.248745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.257644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.276735 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999712715999976 future=<Future at 0x705c4876df10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:33.280038 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Instance destroyed successfully.
May 13 02:19:33.280457 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'resources' on Instance uuid bdf01623-8fe4-467f-9589-c5cfd5f45304 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:33.462545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:33.463016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:33.463016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:33.463016 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:33.463183 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:33.464926 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Terminating instance
May 13 02:19:33.782838 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1032614051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-1032614051',id=72,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-25phgjjh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=bdf01623-8fe4-467f-9589-c5cfd5f45304,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:33.783134 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "6a3f0174-55c0-48be-b997-826d9b9311df", "address": "fa:16:3e:d7:4b:6b", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a3f0174-55", "ovs_interfaceid": "6a3f0174-55c0-48be-b997-826d9b9311df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:33.783790 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:33.784063 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:33.785446 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.785641 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a3f0174-55, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:33.786863 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.787682 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:33.788222 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.788928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.788928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dad28a6-fe3d-49cb-83ad-df66abeab26f) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:33.789755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.789755 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:33.790442 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.791919 np0000000663 nova-compute[98103]: INFO os_vif [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:4b:6b,bridge_name='br-int',has_traffic_filtering=True,id=6a3f0174-55c0-48be-b997-826d9b9311df,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a3f0174-55')
May 13 02:19:33.792232 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Deleting instance files /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304_del
May 13 02:19:33.792929 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Deletion of /opt/stack/data/nova/instances/bdf01623-8fe4-467f-9589-c5cfd5f45304_del complete
May 13 02:19:33.845104 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Found WWN 330000000650e7ced for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:19:33.845396 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:33.845573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000650e7ced', 'path': '/dev/dm-6', 'multipath_id': '330000000650e7ced'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:33.845694 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000650e7ced', 'path': '/dev/dm-6', 'multipath_id': '330000000650e7ced'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:19:33.967645 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:19:33.984534 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:33.989541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.003322 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.006537 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.023320 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.028969 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.116530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:34.120048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:34.120048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:34.120048 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:34.120048 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] No waiting events found dispatching network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:34.120048 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-dd49378d-98a9-4ddf-a2bd-590e8d91f13a req-796c7ab7-2b6b-42b4-b7b9-207d767b9cdf service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:34.208540 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.304052 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Took 1.36 seconds to destroy the instance on the hypervisor.
May 13 02:19:34.305327 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:19:34.305642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:19:34.305757 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:19:34.307033 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:34.309700 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999694893000196 future=<Future at 0x705c6c69da90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:34.311987 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Instance destroyed successfully.
May 13 02:19:34.312727 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 4c853575-60b7-45b0-9260-7d33471ac9d7 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:34.351315 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1455047475',display_name='tempest-instance-1455047475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-instance-1455047475',id=74,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnXJIxCzpSQD1hCjCHD8BxDGA7NY/ISLX2uGf5Yab1k2gQfSoFtY6OrkkOcILBw9v1WJrClz6m9DJQ2bamXcrdE2T7Jp12fyH1Tfc0VqwynEgVssMnXh9X7I1cNNpj/CA==',key_name='tempest-keypair-892570211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751d97a0dee94850a5b3deb439648aa6',ramdisk_id='',reservation_id='r-oavwd7vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645293351',owner_user_name='tempest-VolumesBackupsTest-645293351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba655df8e5e48b4b75b0aa4d9c5a68c',uuid=34fc8c7d-d5ce-4052-9dab-27f6741dd3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:19:34.351590 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converting VIF {"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:34.352210 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:34.352942 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lazy-loading 'pci_devices' on Instance uuid 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:34.389501 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:34.816005 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1493970762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-volume-backed-server-1493970762',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHi8KGigeNhUbko1i6HkEgUQVrQyUMpI2WYm24j3BL9UxK8aM0sUeVN3LoWxkzdCw9gSc+yAWWHR1Mws8bbjMkoB7m4tH7nLhUXRvJu6pHYUiZE/qRq8P0sna0fkC72pGA==',key_name='tempest-keypair-1211053988',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:17:38Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-oobv83wg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7980d292f588498685ffe894352e1443',uuid=4c853575-60b7-45b0-9260-7d33471ac9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:34.816592 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "address": "fa:16:3e:e8:ee:e7", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap567b24a4-b8", "ovs_interfaceid": "567b24a4-b872-4efc-bd7d-f283a0d19f27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:34.816994 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:34.817365 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:34.819121 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.819121 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap567b24a4-b8, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.820431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.820431 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:34.822025 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.822298 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fee9c32-1565-41a3-8f6a-d4f5e6878fef) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.822736 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.823229 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:34.823680 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.826021 np0000000663 nova-compute[98103]: INFO os_vif [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ee:e7,bridge_name='br-int',has_traffic_filtering=True,id=567b24a4-b872-4efc-bd7d-f283a0d19f27,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap567b24a4-b8')
May 13 02:19:34.828043 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:34.828456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:34.828627 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:34.829035 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:34.829433 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371ff342-90e2-461b-b139-b7b9cd40f294', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:34.829591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:34.860512 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] End _get_guest_xml xml=<domain type="qemu">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <uuid>34fc8c7d-d5ce-4052-9dab-27f6741dd3f3</uuid>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <name>instance-0000004a</name>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:name>tempest-instance-1455047475</nova:name>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:19:30</nova:creationTime>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:user uuid="fba655df8e5e48b4b75b0aa4d9c5a68c">tempest-VolumesBackupsTest-645293351-project-member</nova:user>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:project uuid="751d97a0dee94850a5b3deb439648aa6">tempest-VolumesBackupsTest-645293351</nova:project>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         <nova:port uuid="a162fb93-eb04-4d87-bd01-170f5dc59897">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <system>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="serial">34fc8c7d-d5ce-4052-9dab-27f6741dd3f3</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="uuid">34fc8c7d-d5ce-4052-9dab-27f6741dd3f3</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </system>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <os>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </os>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <features>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </features>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   <devices>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.config"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <alias name="ua-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-6"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <target dev="vdb" bus="virtio"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <serial>77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c</serial>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:0c:d1:87"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <target dev="tapa162fb93-eb"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </interface>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/console.log" append="off"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </serial>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <video>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </video>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </rng>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:   </devices>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]: </domain>
May 13 02:19:34.860512 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Preparing to wait for external event network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-1455047475',display_name='tempest-instance-1455047475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-instance-1455047475',id=74,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnXJIxCzpSQD1hCjCHD8BxDGA7NY/ISLX2uGf5Yab1k2gQfSoFtY6OrkkOcILBw9v1WJrClz6m9DJQ2bamXcrdE2T7Jp12fyH1Tfc0VqwynEgVssMnXh9X7I1cNNpj/CA==',key_name='tempest-keypair-892570211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='751d97a0dee94850a5b3deb439648aa6',ramdisk_id='',reservation_id='r-oavwd7vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-645293351',owner_user_name='tempest-VolumesBackupsTest-645293351-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba655df8e5e48b4b75b0aa4d9c5a68c',uuid=34fc8c7d-d5ce-4052-9dab-27f6741dd3f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:19:34.863791 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converting VIF {"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:34.864292 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:34.864518 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:34.865036 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294 (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:34.865500 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:34.865500 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '175')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:34.867055 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.867055 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.867055 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:19:34.868115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.868115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9379d9bf-ae1a-5f88-8336-c3e931e0331c', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.869200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.870127 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:34.871469 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294', '176')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:34.872694 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.874283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa162fb93-eb, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.874283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa162fb93-eb, col_values=(('qos', UUID('2c2e6d6d-7a5f-4541-9a30-90af50b26264')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.874283 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa162fb93-eb, col_values=(('external_ids', {'iface-id': 'a162fb93-eb04-4d87-bd01-170f5dc59897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:d1:87', 'vm-uuid': '34fc8c7d-d5ce-4052-9dab-27f6741dd3f3'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:34.874745 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.876600 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:34.877597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c794d60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:34.878003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:34.878309 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 3300000004e487e90 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:34.882490 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:34.882872 np0000000663 nova-compute[98103]: INFO os_vif [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb')
May 13 02:19:34.939556 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:34.996503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:35.037440 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:35.037633 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:35.038687 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:35.050992 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:35.051212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:35.065645 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.103140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.40.100,3260]
May 13 02:19:35.103140 np0000000663 nova-compute[98103]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.40.100,3260] successful.
May 13 02:19:35.103140 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.125015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.137109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.174338 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.50.100,3260]
May 13 02:19:35.174338 np0000000663 nova-compute[98103]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-371ff342-90e2-461b-b139-b7b9cd40f294, portal: 192.168.50.100,3260] successful.
May 13 02:19:35.174338 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.196102 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:35.196999 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:35.197071 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (368ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:35.197249 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:35.197488 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Deleting instance files /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7_del
May 13 02:19:35.197917 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Deletion of /opt/stack/data/nova/instances/4c853575-60b7-45b0-9260-7d33471ac9d7_del complete
May 13 02:19:35.220790 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:35.220975 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] Acquiring lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:35.221954 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:35.222064 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:35.222240 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] No waiting events found dispatching network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:35.222361 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-57604b75-b8d6-48ad-ba98-c516e29da31c req-ad6dde1c-6092-4e3f-94c1-79f79bc324eb service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-unplugged-6a3f0174-55c0-48be-b997-826d9b9311df for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:35.232515 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:35.707375 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Took 1.74 seconds to destroy the instance on the hypervisor.
May 13 02:19:35.708665 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:19:35.712641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:19:35.712797 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:19:35.713060 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:35.737736 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Took 1.43 seconds to deallocate network for instance.
May 13 02:19:35.843627 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:36.036116 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:36.186382 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:36.186803 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] Acquiring lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:36.186979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:36.187137 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:36.187339 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] No waiting events found dispatching network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:36.187502 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-unplugged-567b24a4-b872-4efc-bd7d-f283a0d19f27 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:36.187658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-270babad-1904-456a-af05-28dc9b9c8605 req-bf7f528b-2793-4cc2-aa59-05b82a70bc13 service nova] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Received event network-vif-deleted-6a3f0174-55c0-48be-b997-826d9b9311df {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:36.242570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:36.242763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:36.269380 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4e72822b-fdb6-41c1-a8c0-aaedefbf4fa0 req-210e0f30-9b54-4bc1-93bc-8bb644b20db7 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Received event network-vif-deleted-567b24a4-b872-4efc-bd7d-f283a0d19f27 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:36.271856 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-4e72822b-fdb6-41c1-a8c0-aaedefbf4fa0 req-210e0f30-9b54-4bc1-93bc-8bb644b20db7 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Neutron deleted interface 567b24a4-b872-4efc-bd7d-f283a0d19f27; detaching it from the instance and deleting it from the info cache
May 13 02:19:36.272250 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-4e72822b-fdb6-41c1-a8c0-aaedefbf4fa0 req-210e0f30-9b54-4bc1-93bc-8bb644b20db7 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:36.403423 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:36.403517 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:36.403914 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:36.403914 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] No VIF found with MAC fa:16:3e:0c:d1:87, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:19:36.404305 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Using config drive
May 13 02:19:36.568959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:36.569224 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:36.719795 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:36.779625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4e72822b-fdb6-41c1-a8c0-aaedefbf4fa0 req-210e0f30-9b54-4bc1-93bc-8bb644b20db7 service nova] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Detach interface failed, port_id=567b24a4-b872-4efc-bd7d-f283a0d19f27, reason: Instance 4c853575-60b7-45b0-9260-7d33471ac9d7 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:19:36.910126 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:37.045387 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Creating config drive at /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.config
May 13 02:19:37.048777 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4n90a12n {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:37.075691 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:37.115296 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4n90a12n" returned: 0 in 0.066s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:19:37.221906 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Took 1.51 seconds to deallocate network for instance.
May 13 02:19:37.555240 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.577319 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.584813 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.342s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:37.639185 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Deleted allocations for instance bdf01623-8fe4-467f-9589-c5cfd5f45304
May 13 02:19:37.675085 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.779587 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:19:37.782489 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Deleting volume: 371ff342-90e2-461b-b139-b7b9cd40f294 {{(pid=98103) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 13 02:19:37.893530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.899039 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.901260 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:37.919960 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:38.241633 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:38.244186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:38.244186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:38.244186 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:38.244186 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Processing event network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:19:38.244296 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:38.244410 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:38.244525 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:38.244614 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:38.244716 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] No waiting events found dispatching network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:38.244819 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-e5ac5ae9-3acd-4c71-8422-d32f35f7bcba req-35fb9f71-980c-4ff2-9dae-0d0889ce551b service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received unexpected event network-vif-plugged-a162fb93-eb04-4d87-bd01-170f5dc59897 for instance with vm_state building and task_state spawning.
May 13 02:19:38.339242 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:38.339413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:38.379798 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638778.3793588, 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:38.380002 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] VM Started (Lifecycle Event)
May 13 02:19:38.381471 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:19:38.386804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:19:38.387425 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Instance spawned successfully.
May 13 02:19:38.387683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:19:38.606829 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:38.607104 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:38.647368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-db05b723-5378-4e28-9caa-f974c7f9c3f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "bdf01623-8fe4-467f-9589-c5cfd5f45304" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.208s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:38.883575 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:38.886009 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:38.899733 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:38.899733 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:38.899959 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:38.900111 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:38.900443 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:38.903479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:19:39.109889 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:39.388083 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:19:39.388259 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638779.3880744, 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:39.388355 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] VM Paused (Lifecycle Event)
May 13 02:19:39.405153 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Took 9.10 seconds to spawn the instance on the hypervisor.
May 13 02:19:39.405293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:39.619126 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.277s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:39.685876 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 4c853575-60b7-45b0-9260-7d33471ac9d7
May 13 02:19:39.809067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:39.809368 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:39.876262 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:39.890315 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:39.892309 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638779.8921251, 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:39.892411 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] VM Resumed (Lifecycle Event)
May 13 02:19:39.912751 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Took 16.77 seconds to build instance.
May 13 02:19:40.102640 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0006884750000608619 future=<Future at 0x705c6c69d0a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:40.103354 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638765.1018312, 59751567-2cc2-410c-a5e2-e7c98b6382c0 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:40.103541 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:40.103766 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] VM Stopped (Lifecycle Event)
May 13 02:19:40.104839 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.171586940999987 future=<Future at 0x705c4876df10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:40.105002 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=8.17140260799988 future=<Future at 0x705c4876df10 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:40.311490 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Detaching volume bd72a680-95f9-4bf0-b217-04618c8cf4fa
May 13 02:19:40.347455 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to driver detach volume bd72a680-95f9-4bf0-b217-04618c8cf4fa from mountpoint /dev/vdd
May 13 02:19:40.352363 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdd by alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:40.353439 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdd by alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:40.353587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Attempting to detach device vdd from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:19:40.353847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <target dev="vdd" bus="virtio"/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:40.353847 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:40.359417 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdd from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config.
May 13 02:19:40.359589 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] (1/8): Attempting to detach device vdd with device alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:19:40.359804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <alias name="ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa"/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <target dev="vdd" bus="virtio"/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <serial>bd72a680-95f9-4bf0-b217-04618c8cf4fa</serial>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:40.359804 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:40.395104 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:40.397988 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:19:40.414119 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-34f3bbf2-f0ca-4436-a15c-c25e74c91bbc tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.279s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:40.606580 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 59751567-2cc2-410c-a5e2-e7c98b6382c0] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:40.692563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-d6d664a8-be2a-4221-815b-b29d3893ee58 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "4c853575-60b7-45b0-9260-7d33471ac9d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.229s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:40.900428 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638780.9000106, c19374b4-2270-4a5d-ba5c-251d9c52797e => ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:19:40.901993 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-bd72a680-95f9-4bf0-b217-04618c8cf4fa for instance c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:19:40.904789 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdd from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config.
May 13 02:19:40.936452 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:40.936769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:40.936897 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:40.937341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:40.937590 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bd72a680-95f9-4bf0-b217-04618c8cf4fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:40.937711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:40.969421 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [188] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [189] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:40.969950 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:40.969950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '188')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:40.971065 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa', '189')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:40.971997 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c7420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'): ({'sdh'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:40.973024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Removing multipathed devices sdh, sdg {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:40.973377 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flush multipath device 330000000ed3ff9d0 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:41.025583 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:41.039388 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:41.070807 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:41.122684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if SCSI volumes sdh, sdg have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:41.122841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] SCSI volumes sdh, sdg have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:41.124185 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if device paths {'sdh', 'sdg'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:41.143689 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Device paths {'sdh', 'sdg'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:41.144032 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:41.159639 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.212019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.40.100,3260]
May 13 02:19:41.212019 np0000000663 nova-compute[98103]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.40.100,3260] successful.
May 13 02:19:41.212019 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.224157 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-changed-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:41.224485 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Refreshing instance network info cache due to event network-changed-a162fb93-eb04-4d87-bd01-170f5dc59897. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:41.225285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] Acquiring lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:41.225285 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] Acquired lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:41.225285 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Refreshing network info cache for port a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:41.231196 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.242441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.282109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.50.100,3260]
May 13 02:19:41.282109 np0000000663 nova-compute[98103]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-bd72a680-95f9-4bf0-b217-04618c8cf4fa, portal: 192.168.50.100,3260] successful.
May 13 02:19:41.282109 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.300943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:41.301190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:41.301296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== disconnect_volume: return (364ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:41.301426 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:41.727451 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:41.848471 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:42.040200 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:42.180261 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updated VIF entry in instance network info cache for port a162fb93-eb04-4d87-bd01-170f5dc59897. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:19:42.180261 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating instance_info_cache with network_info: [{"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:42.681589 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ddf4b59b-cfe2-48d2-b3cf-44524581992c req-97aedbee-65b1-45b5-be8d-82654fd91e8f service nova] Releasing lock "refresh_cache-34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:42.857751 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-75b7fda6-f3db-4e90-9b02-65b4ba8ce9f9 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.048s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:43.110726 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:43.110959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:43.613399 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Detaching volume 67be8013-d9a2-49c9-94ae-110d53f6151b
May 13 02:19:43.660933 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to driver detach volume 67be8013-d9a2-49c9-94ae-110d53f6151b from mountpoint /dev/vdc
May 13 02:19:43.688749 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'c19374b4-2270-4a5d-ba5c-251d9c52797e', 'attached_at': '', 'detached_at': '', 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'serial': '67be8013-d9a2-49c9-94ae-110d53f6151b'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:19:43.694568 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdc by alias ua-67be8013-d9a2-49c9-94ae-110d53f6151b {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:43.695730 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdc by alias ua-67be8013-d9a2-49c9-94ae-110d53f6151b {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:43.695882 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Attempting to detach device vdc from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:19:43.696175 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <alias name="ua-67be8013-d9a2-49c9-94ae-110d53f6151b"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <serial>67be8013-d9a2-49c9-94ae-110d53f6151b</serial>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="3b9eb462-9ecd-42fc-9748-b9ca85d40734"/>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:43.696175 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:43.702083 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdc from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config.
May 13 02:19:43.702257 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] (1/8): Attempting to detach device vdc with device alias ua-67be8013-d9a2-49c9-94ae-110d53f6151b from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:19:43.702502 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <alias name="ua-67be8013-d9a2-49c9-94ae-110d53f6151b"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <serial>67be8013-d9a2-49c9-94ae-110d53f6151b</serial>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   <encryption format="luks">
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:     <secret type="passphrase" uuid="3b9eb462-9ecd-42fc-9748-b9ca85d40734"/>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:   </encryption>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:43.702502 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:44.179211 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638784.1788409, c19374b4-2270-4a5d-ba5c-251d9c52797e => ua-67be8013-d9a2-49c9-94ae-110d53f6151b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:19:44.181038 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-67be8013-d9a2-49c9-94ae-110d53f6151b for instance c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:19:44.183239 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdc from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config.
May 13 02:19:44.185603 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:44.185970 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:44.186197 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:44.186537 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:44.186877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '67be8013-d9a2-49c9-94ae-110d53f6151b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:44.187049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:44.215403 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [185] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [186] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:44.215693 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:44.215693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:44.215938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '185')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:44.216700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b', '186')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:44.217549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487c53a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'): ({'sdj'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:44.217715 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Removing multipathed devices sdi, sdj {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:44.217917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flush multipath device 3300000008c746905 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:44.250426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:44.291733 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:44.338496 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if SCSI volumes sdi, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:44.338661 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] SCSI volumes sdi, sdj have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:44.339675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if device paths {'sdi', 'sdj'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:44.350679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Device paths {'sdi', 'sdj'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:44.350852 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:44.363986 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.398240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.40.100,3260]
May 13 02:19:44.398240 np0000000663 nova-compute[98103]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.40.100,3260] successful.
May 13 02:19:44.398240 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.421061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.432578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.461110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.50.100,3260]
May 13 02:19:44.461110 np0000000663 nova-compute[98103]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-67be8013-d9a2-49c9-94ae-110d53f6151b, portal: 192.168.50.100,3260] successful.
May 13 02:19:44.461110 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.478595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:44.479436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:44.479573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== disconnect_volume: return (293ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:44.479711 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:44.893239 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:45.024871 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:45.940055 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:45.940455 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:46.032072 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-5b444b60-bb8b-4f6d-8853-145a7f458c2e tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.921s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:46.052332 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.338794 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:46.339011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:46.339269 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:46.340026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:46.340234 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:46.342495 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Terminating instance
May 13 02:19:46.396109 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:46.396433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:46.442292 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:19:46.845835 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:19:46.865066 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.873931 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.892472 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.894106 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.898622 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Detaching volume 7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8
May 13 02:19:46.921100 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.921533 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:46.949669 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Attempting to driver detach volume 7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 from mountpoint /dev/vdb
May 13 02:19:46.966865 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:46.968905 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:46.969023 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Attempting to detach device vdb from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:19:46.969309 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <alias name="ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8"/>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <serial>7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8</serial>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:46.969309 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:46.979427 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the persistent domain config.
May 13 02:19:46.979732 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] (1/8): Attempting to detach device vdb with device alias ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:19:46.979928 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <alias name="ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8"/>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <serial>7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8</serial>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:46.979928 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:47.004920 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:47.005262 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:47.012689 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:19:47.012878 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Claim successful on node np0000000663
May 13 02:19:47.023135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:47.023402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:47.023597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:47.023756 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:47.024110 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] No waiting events found dispatching network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:47.024663 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d20a20f8-0135-47fa-931b-59b4e9fd589b req-e54f07a5-af07-4754-ae15-cb04eda0cded service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:47.159765 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999744584999917 future=<Future at 0x705c882a1e80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:47.162116 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Instance destroyed successfully.
May 13 02:19:47.162657 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'resources' on Instance uuid f8726c6d-901d-40da-b3b3-d66be3b9a5de {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:47.439059 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638787.438717, c19374b4-2270-4a5d-ba5c-251d9c52797e => ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:19:47.440110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 for instance c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:19:47.442743 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance c19374b4-2270-4a5d-ba5c-251d9c52797e from the live domain config.
May 13 02:19:47.443992 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:47.444360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:47.444516 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:47.444977 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:47.445931 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:47.446176 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.470456 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [181] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8 (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.470703 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:47.470842 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:47.470898 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '180')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:47.472285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8', '181')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:47.473459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c6993a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:47.473720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:47.474033 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flush multipath device 33000000078579962 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:47.509397 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:47.555674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:47.598291 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:47.598445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:47.599360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:47.610003 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:47.610230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:47.622441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.657001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.40.100,3260]
May 13 02:19:47.657001 np0000000663 nova-compute[98103]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.40.100,3260] successful.
May 13 02:19:47.657001 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.666917 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1007430161',display_name='tempest-TestEncryptedCinderVolumes-server-1007430161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-1007430161',id=73,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:19:20Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-y20dpla3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:19:20Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=f8726c6d-901d-40da-b3b3-d66be3b9a5de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:47.667105 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "address": "fa:16:3e:12:4c:f7", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape1cbab4e-78", "ovs_interfaceid": "e1cbab4e-7879-4ec6-b7ba-c72d005ce76b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:47.667656 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:47.667909 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:47.669068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:47.669290 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1cbab4e-78, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:47.670453 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:47.671361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:47.672448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:47.673380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:47.673528 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cc01138-4cf8-4496-8e8b-1999f5700bbe) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:47.673978 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.675449 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:47.678145 np0000000663 nova-compute[98103]: INFO os_vif [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:4c:f7,bridge_name='br-int',has_traffic_filtering=True,id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1cbab4e-78')
May 13 02:19:47.681265 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:47.681539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:47.681658 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:47.684211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.717790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.50.100,3260]
May 13 02:19:47.717790 np0000000663 nova-compute[98103]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-7fe4c9a3-a3be-4c5f-8d9e-ec118371e6d8, portal: 192.168.50.100,3260] successful.
May 13 02:19:47.717790 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.731482 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.731840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:47.731984 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.050s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:47.732299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '21152699-9371-476e-8c1b-eacaf7328d0e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:47.732504 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:47.732642 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== disconnect_volume: return (287ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:47.732752 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.758478 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: tcp: [205] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: tcp: [206] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:47.758714 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:47.758932 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:47.759019 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '206')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:47.759801 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e', '205')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:47.760675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c698900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'): ({'sdo'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:47.760871 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Removing multipathed devices sdp, sdo {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:47.761110 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flush multipath device 330000000da5624c1 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:47.802152 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:47.833654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:47.873296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if SCSI volumes sdp, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:47.873432 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] SCSI volumes sdp, sdo have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:47.874212 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if device paths {'sdp', 'sdo'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:47.884593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Device paths {'sdp', 'sdo'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:47.884750 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:47.895786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.928495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.40.100,3260]
May 13 02:19:47.928495 np0000000663 nova-compute[98103]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.40.100,3260] successful.
May 13 02:19:47.928495 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.941483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.952011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.979703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.50.100,3260]
May 13 02:19:47.979703 np0000000663 nova-compute[98103]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-21152699-9371-476e-8c1b-eacaf7328d0e, portal: 192.168.50.100,3260] successful.
May 13 02:19:47.979703 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.992229 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:47.993226 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:47.993335 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== disconnect_volume: return (311ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:47.993434 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:47.993661 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Deleting instance files /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de_del
May 13 02:19:47.994045 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Deletion of /opt/stack/data/nova/instances/f8726c6d-901d-40da-b3b3-d66be3b9a5de_del complete
May 13 02:19:48.270523 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:48.276916 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00045690199976888834 future=<Future at 0x705c4876df10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:48.277486 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638773.2763314, bdf01623-8fe4-467f-9589-c5cfd5f45304 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:48.277696 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:48.277928 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] VM Stopped (Lifecycle Event)
May 13 02:19:48.278530 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.031031914000323 future=<Future at 0x705c6c69da90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:48.279469 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.0297446730000956 future=<Future at 0x705c6c69da90 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:48.317397 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:48.317545 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:48.500977 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Took 1.65 seconds to destroy the instance on the hypervisor.
May 13 02:19:48.502466 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:19:48.502641 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:19:48.502737 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:19:48.503004 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:48.599990 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:48.782109 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: bdf01623-8fe4-467f-9589-c5cfd5f45304] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:48.820293 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:49.029535 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-312bac8c-001b-406b-a324-a7fa95259854 req-6f020436-2c8e-4d60-a1d3-ab86e1c0e6d5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-deleted-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:49.029939 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-312bac8c-001b-406b-a324-a7fa95259854 req-6f020436-2c8e-4d60-a1d3-ab86e1c0e6d5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Neutron deleted interface e1cbab4e-7879-4ec6-b7ba-c72d005ce76b; detaching it from the instance and deleting it from the info cache
May 13 02:19:49.029939 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-312bac8c-001b-406b-a324-a7fa95259854 req-6f020436-2c8e-4d60-a1d3-ab86e1c0e6d5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:49.083397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:49.083643 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] Acquiring lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:49.083816 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:49.083991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:49.084150 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] No waiting events found dispatching network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:49.084205 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4417f724-cce7-44c1-810c-c80c3283f5fd req-5c3f9b71-7219-4172-9051-fc9a736cb6b5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Received event network-vif-unplugged-e1cbab4e-7879-4ec6-b7ba-c72d005ce76b for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:49.278128 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1af35eb2-2965-407b-84e5-3c3e763ff8d7 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.882s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:49.309556 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004401699998197728 future=<Future at 0x705c6c69da90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:49.310020 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638774.3090146, 4c853575-60b7-45b0-9260-7d33471ac9d7 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:19:49.310183 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:49.310340 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] VM Stopped (Lifecycle Event)
May 13 02:19:49.310439 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=12.849044690000028 future=<Future at 0x705c882a1e80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:49.310894 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=12.84858636800027 future=<Future at 0x705c882a1e80 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:49.327831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.323s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:49.328067 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:19:49.480396 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:49.533405 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-312bac8c-001b-406b-a324-a7fa95259854 req-6f020436-2c8e-4d60-a1d3-ab86e1c0e6d5 service nova] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Detach interface failed, port_id=e1cbab4e-7879-4ec6-b7ba-c72d005ce76b, reason: Instance f8726c6d-901d-40da-b3b3-d66be3b9a5de could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:19:49.815115 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 4c853575-60b7-45b0-9260-7d33471ac9d7] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:19:49.834328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:19:49.834755 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:19:49.835030 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:49.835306 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:49.916648 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:19:49.981751 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Took 1.48 seconds to deallocate network for instance.
May 13 02:19:50.335484 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:19:50.380584 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Successfully created port: 998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:19:50.530627 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Took 0.55 seconds to detach 1 volumes for instance.
May 13 02:19:50.814434 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Successfully updated port: 998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:19:50.840207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:19:51.039689 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:51.039856 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:51.061005 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:51.086642 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-changed-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:51.087053 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Refreshing instance network info cache due to event network-changed-998043fe-d890-43af-9004-360b27f55c36. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:51.087306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] Acquiring lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:51.087745 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] Acquired lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:51.087745 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Refreshing network info cache for port 998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:51.275357 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:51.275525 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:51.316264 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:51.345347 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Booting with volume 8009b6b3-8da6-4b8e-b848-77d2d2d8d643 at /dev/vda
May 13 02:19:51.386539 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:51.396695 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:19:51.417881 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:51.466191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:19:51.466483 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:19:51.474207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:19:51.475256 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fec2:a878', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe35:479e', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fe0c:d187', 'fe80::5c03:9fff:fe76:a6cc'] 
May 13 02:19:51.475393 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:19:51.475485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:19:51.475678 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:51.475900 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating existing volume attachment record: d2167ac4-1a95-4f40-be3a-a182a3f16a6f {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:19:51.589600 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:51.643697 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:19:51.775674 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:51.778047 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:52.277822 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b33da706-95e0-4bfd-b437-869406cf867c req-e595673c-ef85-44bc-807c-4cb4ea19d57d service nova] Releasing lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:52.278197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:52.278344 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:19:52.284729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.245s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:52.328383 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deleted allocations for instance f8726c6d-901d-40da-b3b3-d66be3b9a5de
May 13 02:19:52.674261 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:52.861948 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:19:53.007405 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:53.086524 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:53.086709 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:53.086929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:53.087081 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:53.087233 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:53.089459 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Terminating instance
May 13 02:19:53.154755 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating instance_info_cache with network_info: [{"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:53.336961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-67c34594-7580-463d-ad4b-0c0eeec1e498 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "f8726c6d-901d-40da-b3b3-d66be3b9a5de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.998s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:53.567352 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:19:53.568413 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:19:53.568623 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Creating image(s)
May 13 02:19:53.568887 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:19:53.569008 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Ensure instance console log exists: /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:19:53.569229 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:53.569409 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:53.569526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:53.595367 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:19:53.614823 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.617253 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.636474 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.641567 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.658639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:53.658917 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance network_info: |[{"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:19:53.661839 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Start _get_guest_xml network_info=[{"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '90e1017f-ad0b-497c-aa9c-1e9312587a5d', 'attached_at': '', 'detached_at': '', 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'serial': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643'}, 'attachment_id': 'd2167ac4-1a95-4f40-be3a-a182a3f16a6f', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:19:53.661839 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.665598 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:19:53.666939 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1721334351', uuid='90e1017f-ad0b-497c-aa9c-1e9312587a5d'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638793.6665716) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:19:53.668481 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.669323 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:19:53.669671 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:19:53.671103 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:19:53.671352 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:19:53.672376 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:19:53.672702 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:19:53.672877 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:19:53.672996 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:19:53.673190 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:19:53.673309 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:19:53.673423 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:19:53.673605 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:19:53.673733 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:19:53.673873 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:19:53.673996 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:19:53.676987 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:19:53.696262 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:19:53.696667 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:53.696982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:53.697877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:53.697877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:19:53.712374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:53.713000 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:53.713714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:53.713919 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:53.714398 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:53.714618 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:53.726703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:53.726703 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:53.732282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:19:53.732282 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:53.739760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643] added
May 13 02:19:53.739760 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:53.739760 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:53.739760 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:53.739760 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:53.739760 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:53.739760 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:53.740046 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:53.740245 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:53.740635 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:53.743913 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643] added
May 13 02:19:53.743913 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:19:53.743913 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:53.743913 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:53.743913 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:19:53.743913 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:19:53.743913 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:53.744424 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:19:53.744424 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:19:53.744424 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:19:53.836138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:53.837002 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:53.837197 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:53.838477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:53.838477 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] No waiting events found dispatching network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:53.838477 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-47198ebf-2a87-4097-baf9-c3ca266522de req-4a9833fd-09ce-44b4-8443-3e2c6360a4d8 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:53.895370 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.902228 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:53.932974 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999713157000315 future=<Future at 0x705c4870d6a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:19:53.937610 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Instance destroyed successfully.
May 13 02:19:53.939122 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'resources' on Instance uuid c19374b4-2270-4a5d-ba5c-251d9c52797e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:54.442640 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:16:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-160403114',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-160403114',id=66,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPX5yj8DDmadMOLz1rFAJhbJD/17RBNEetFE5Wl1RYIxD+9zz6SdBJjgMCBtyk4704roVfDRff5tWwOjwS8KRugX9b9mxD/Ef+NsN6pgmo7OZk6fU3M2hFK1aZLPHhSa1Q==',key_name='tempest-keypair-2098697263',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:17:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-8tdn6vb7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=c19374b4-2270-4a5d-ba5c-251d9c52797e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:19:54.442816 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "346253e0-41cf-475d-82d3-9052880cc0c2", "address": "fa:16:3e:c2:a8:78", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap346253e0-41", "ovs_interfaceid": "346253e0-41cf-475d-82d3-9052880cc0c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:54.443426 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:54.443640 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:19:54.444894 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:54.445166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap346253e0-41, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:54.446870 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:54.447741 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:54.449491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:54.449632 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e63936ef-b376-4092-9a0c-d33267d5ec9c) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:54.450193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:54.450715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:54.451324 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:54.453168 np0000000663 nova-compute[98103]: INFO os_vif [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:a8:78,bridge_name='br-int',has_traffic_filtering=True,id=346253e0-41cf-475d-82d3-9052880cc0c2,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346253e0-41')
May 13 02:19:54.453439 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Deleting instance files /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e_del
May 13 02:19:54.454116 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Deletion of /opt/stack/data/nova/instances/c19374b4-2270-4a5d-ba5c-251d9c52797e_del complete
May 13 02:19:54.698129 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:54.698587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing instance network info cache due to event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:54.698769 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:54.698894 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:54.699014 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:54.740959 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:19:54.744880 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:54.753586 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:54.753586 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:19:54.763234 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:19:54.763234 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.767689 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.779419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.791416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.791416 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.791416 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.791416 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.791416 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:54.791700 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.791700 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.791700 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.791700 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.791700 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:54.792124 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.792124 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.792124 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.792124 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.792124 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:54.792295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.792295 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.792295 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.792295 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.792295 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:54.830240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260]
May 13 02:19:54.830240 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260] successful.
May 13 02:19:54.830240 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.830963 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260]
May 13 02:19:54.830963 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260] successful.
May 13 02:19:54.830963 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.841668 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.846869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.859876 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.860186 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:54.860385 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:54.860518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:54.861536 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 210 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:54.861692 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.867024 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:54.867264 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:54.867518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:54.867657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:19:54.868383 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('7', '-', '-', 0) found on session 209 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:19:54.868515 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:19:54.876641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 210 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:54.876641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:54.885183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 209 and hctl ['7', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:54.963938 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Took 1.37 seconds to destroy the instance on the hypervisor.
May 13 02:19:54.971934 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:19:54.972373 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:19:54.972521 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:19:54.972724 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:55.081614 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:55.201079 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:55.289025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:55.289236 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:55.359343 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a7086e88-e748-4d20-a40b-6199a5f88704 req-f7f92cf7-cf2b-494b-8d5a-0ca078b7a9d7 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-deleted-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:55.359469 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-a7086e88-e748-4d20-a40b-6199a5f88704 req-f7f92cf7-cf2b-494b-8d5a-0ca078b7a9d7 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Neutron deleted interface 346253e0-41cf-475d-82d3-9052880cc0c2; detaching it from the instance and deleting it from the info cache
May 13 02:19:55.359574 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a7086e88-e748-4d20-a40b-6199a5f88704 req-f7f92cf7-cf2b-494b-8d5a-0ca078b7a9d7 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:55.473718 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:55.579775 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updated VIF entry in instance network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:19:55.579864 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:55.791246 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Detaching volume 5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c
May 13 02:19:55.808820 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:55.822905 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Attempting to driver detach volume 5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c from mountpoint /dev/vdb
May 13 02:19:55.826977 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found disk vdb by alias ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:55.828069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found disk vdb by alias ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:19:55.828209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Attempting to detach device vdb from instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:19:55.828482 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <alias name="ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c"/>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-9"/>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <serial>5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c</serial>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:55.828482 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:55.833324 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully detached device vdb from instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 from the persistent domain config.
May 13 02:19:55.833436 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] (1/8): Attempting to detach device vdb with device alias ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c from instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:19:55.833639 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <alias name="ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c"/>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-9"/>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <serial>5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c</serial>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]: </disk>
May 13 02:19:55.833639 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:19:55.865600 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a7086e88-e748-4d20-a40b-6199a5f88704 req-f7f92cf7-cf2b-494b-8d5a-0ca078b7a9d7 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Detach interface failed, port_id=346253e0-41cf-475d-82d3-9052880cc0c2, reason: Instance c19374b4-2270-4a5d-ba5c-251d9c52797e could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:19:55.885831 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:55.885831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Acquiring lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:55.886049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:55.886135 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:55.886284 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] No waiting events found dispatching network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:19:55.886412 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Received event network-vif-unplugged-346253e0-41cf-475d-82d3-9052880cc0c2 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:19:55.886540 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:19:55.886678 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing instance network info cache due to event network-changed-1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:19:55.886815 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Acquiring lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:19:55.887190 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 209 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:19:55.887314 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:19:56.062427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:56.081615 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-17a19460-402f-4cef-be89-986d22e97938 req-2f8cb16b-29b1-41ce-b7b3-cea3cf0b197c service nova] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:56.081980 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Acquired lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:19:56.082163 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Refreshing network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:19:56.311618 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Took 1.34 seconds to deallocate network for instance.
May 13 02:19:56.323215 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638796.3227797, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:19:56.324074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c for instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:19:56.326159 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully detached device vdb from instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8 from the live domain config.
May 13 02:19:56.327291 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:19:56.327531 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:19:56.327669 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:19:56.584054 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:56.730709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 330000000bc7bdbad for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:19:56.730943 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:56.731080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '330000000bc7bdbad', 'path': '/dev/dm-0', 'multipath_id': '330000000bc7bdbad'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:56.731236 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bc7bdbad', 'path': '/dev/dm-0', 'multipath_id': '330000000bc7bdbad'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:19:56.731752 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.404s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:19:56.732188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:19:56.732429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:56.755312 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:19:56.755565 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:19:56.755703 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '210')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:19:56.755766 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '203')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:56.756624 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c', '204')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:19:56.757681 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7f6ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'): ({'sdn'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:19:56.757912 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Removing multipathed devices sdn, sdm {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:19:56.758227 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flush multipath device 3300000004f322818 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:19:56.795571 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:56.816910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:56.817495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:56.836208 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:56.839363 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:19:56.889826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:19:56.889826 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:19:56.890666 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:19:56.903602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:19:56.903850 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:19:56.915717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:56.953815 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260]
May 13 02:19:56.953815 np0000000663 nova-compute[98103]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.40.100,3260] successful.
May 13 02:19:56.953815 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:56.972254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:56.982500 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updated VIF entry in instance network info cache for port 1effd6a6-381d-4c92-b42b-ca4eb0f6200f. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:19:56.983310 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:56.983602 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [{"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:19:57.014872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260]
May 13 02:19:57.014872 np0000000663 nova-compute[98103]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-5995a2ad-ce7c-43be-9c48-ca3fec1a6f2c, portal: 192.168.50.100,3260] successful.
May 13 02:19:57.014872 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:57.027752 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:19:57.027972 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:19:57.028154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== disconnect_volume: return (700ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:19:57.028331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:19:57.042903 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:19:57.043146 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:19:57.239587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1721334351',display_name='tempest-TestVolumeBootPattern-server-1721334351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1721334351',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cywm870s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:51Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=90e1017f-ad0b-497c-aa9c-1e9312587a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:19:57.239800 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:57.240201 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:57.240673 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 90e1017f-ad0b-497c-aa9c-1e9312587a5d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:57.485683 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cc064e6a-5bac-4bd3-abfb-d6092b7cd812 req-3c7b9947-3fd3-4993-aeed-81346dd2e7a2 service nova] Releasing lock "refresh_cache-75ef4b67-07c0-4399-9d88-d5a6c77207a8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:19:57.545480 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:19:57.567779 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:19:57.743147 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] End _get_guest_xml xml=<domain type="qemu">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <uuid>90e1017f-ad0b-497c-aa9c-1e9312587a5d</uuid>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <name>instance-0000004b</name>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-1721334351</nova:name>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:19:53</nova:creationTime>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         <nova:port uuid="998043fe-d890-43af-9004-360b27f55c36">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <system>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="serial">90e1017f-ad0b-497c-aa9c-1e9312587a5d</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="uuid">90e1017f-ad0b-497c-aa9c-1e9312587a5d</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </system>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <os>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </os>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <features>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </features>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   <devices>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/disk.config"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <alias name="ua-8009b6b3-8da6-4b8e-b848-77d2d2d8d643"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <serial>8009b6b3-8da6-4b8e-b848-77d2d2d8d643</serial>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </disk>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:97:75:56"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <target dev="tap998043fe-d8"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </interface>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/console.log" append="off"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </serial>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <video>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </video>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </rng>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:   </devices>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]: </domain>
May 13 02:19:57.743147 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Preparing to wait for external event network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1721334351',display_name='tempest-TestVolumeBootPattern-server-1721334351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1721334351',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cywm870s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:19:51Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=90e1017f-ad0b-497c-aa9c-1e9312587a5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:19:57.745047 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:19:57.745390 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:19:57.745390 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.745466 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:57.745633 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:19:57.746075 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.746242 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c85475e9-0f2c-54e4-a95c-a82dbefd498f', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:57.746935 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.747719 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:57.748080 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.749526 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.749644 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap998043fe-d8, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:57.749896 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap998043fe-d8, col_values=(('qos', UUID('922e1407-a20d-4336-9423-ac1e6011446a')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:57.750036 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap998043fe-d8, col_values=(('external_ids', {'iface-id': '998043fe-d890-43af-9004-360b27f55c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:75:56', 'vm-uuid': '90e1017f-ad0b-497c-aa9c-1e9312587a5d'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:19:57.751204 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.752544 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:19:57.756478 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:19:57.757120 np0000000663 nova-compute[98103]: INFO os_vif [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8')
May 13 02:19:58.050898 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.234s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:58.095323 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Deleted allocations for instance c19374b4-2270-4a5d-ba5c-251d9c52797e
May 13 02:19:58.572819 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-1de0d30c-c6f7-498a-b179-55c3d1fe692d tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.283s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:59.105658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-af91d0a1-a056-4167-a65e-dda28aa5e76d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "c19374b4-2270-4a5d-ba5c-251d9c52797e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.019s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:19:59.272536 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:59.272671 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:19:59.272799 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:97:75:56, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:19:59.273227 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Using config drive
May 13 02:19:59.778112 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:19:59.884244 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:19:59.884397 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 13 02:19:59.889170 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Creating config drive at /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/disk.config
May 13 02:19:59.891996 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpee4a6u60 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:19:59.947265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpee4a6u60" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:00.377970 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.386415 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] There are 0 instances to clean {{(pid=98103) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 13 02:20:00.386781 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:00.416835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.416835 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.503667 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.587177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-54ecdce0-08fd-4059-8aae-0d521e088b44 req-4aa91986-c477-40d9-ae86-cbab6e80644a service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:00.588656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-54ecdce0-08fd-4059-8aae-0d521e088b44 req-4aa91986-c477-40d9-ae86-cbab6e80644a service nova] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:00.588656 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-54ecdce0-08fd-4059-8aae-0d521e088b44 req-4aa91986-c477-40d9-ae86-cbab6e80644a service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:00.588868 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-54ecdce0-08fd-4059-8aae-0d521e088b44 req-4aa91986-c477-40d9-ae86-cbab6e80644a service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:00.589972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-54ecdce0-08fd-4059-8aae-0d521e088b44 req-4aa91986-c477-40d9-ae86-cbab6e80644a service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Processing event network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:20:00.651296 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:00.651494 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:00.651993 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:00.652166 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:00.652322 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:00.654748 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Terminating instance
May 13 02:20:00.707815 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.711206 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.716251 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:00.737735 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.075399 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.158190 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:20:01.174282 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.177703 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.196634 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.201455 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.215986 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.219888 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:01.312170 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638801.311438, 90e1017f-ad0b-497c-aa9c-1e9312587a5d => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:01.312901 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:20:01.313124 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] VM Started (Lifecycle Event)
May 13 02:20:01.321119 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:20:01.325165 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance spawned successfully.
May 13 02:20:01.329226 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:20:01.528557 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Instance destroyed successfully.
May 13 02:20:01.528557 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'resources' on Instance uuid 75ef4b67-07c0-4399-9d88-d5a6c77207a8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:01.819051 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:01.821754 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:01.835784 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:01.835910 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:01.836268 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:01.836587 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:01.836992 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:01.837302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:02.033131 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1460398376',display_name='tempest-TestMinimumBasicScenario-server-1460398376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-1460398376',id=70,image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNQbmSqLbYYehIiY0CO8kN1KkTZkzwoE/LNRF185s+3RJypPdtgyaVGTGU2rBOXuFsXUxNIRgLHbzyj2kFS+3rE79d2BBBumJX97NjYbEOickEDzRCLAkhTo5Oyx5szA==',key_name='tempest-TestMinimumBasicScenario-1901193877',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:18:27Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-0v406bon',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='2cf52914-ccbd-4f24-bbbc-332fd218a34e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:19:16Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=75ef4b67-07c0-4399-9d88-d5a6c77207a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:20:02.033131 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "address": "fa:16:3e:35:47:9e", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1effd6a6-38", "ovs_interfaceid": "1effd6a6-381d-4c92-b42b-ca4eb0f6200f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:02.033131 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:02.033131 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:20:02.036530 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.036871 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1effd6a6-38, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:02.038159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.042130 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:02.042130 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.042709 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.042940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=602a7a39-be5b-4675-bffc-9da67d8dfd88) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:02.043637 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.044458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:02.045370 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:02.047746 np0000000663 nova-compute[98103]: INFO os_vif [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:47:9e,bridge_name='br-int',has_traffic_filtering=True,id=1effd6a6-381d-4c92-b42b-ca4eb0f6200f,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1effd6a6-38')
May 13 02:20:02.048036 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Deleting instance files /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8_del
May 13 02:20:02.048806 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Deletion of /opt/stack/data/nova/instances/75ef4b67-07c0-4399-9d88-d5a6c77207a8_del complete
May 13 02:20:02.160062 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00047737099976075115 future=<Future at 0x705c882a1e80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:02.161949 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638787.1594217, f8726c6d-901d-40da-b3b3-d66be3b9a5de => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:02.162213 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:02.162470 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] VM Stopped (Lifecycle Event)
May 13 02:20:02.163629 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.7690825980002955 future=<Future at 0x705c4870d6a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:02.164398 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=6.768271060000188 future=<Future at 0x705c4870d6a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:02.324143 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:20:02.324533 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638802.3242347, 90e1017f-ad0b-497c-aa9c-1e9312587a5d => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:02.324533 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] VM Paused (Lifecycle Event)
May 13 02:20:02.343887 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Took 8.78 seconds to spawn the instance on the hypervisor.
May 13 02:20:02.344328 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:02.380523 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:02.380839 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:02.381053 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:02.381286 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:02.554944 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Took 1.40 seconds to destroy the instance on the hypervisor.
May 13 02:20:02.555560 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:20:02.555914 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:20:02.556015 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:20:02.556326 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:02.668138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: f8726c6d-901d-40da-b3b3-d66be3b9a5de] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:02.668138 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:02.668824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:02.668978 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:02.669127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:02.669268 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] No waiting events found dispatching network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:02.669416 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received unexpected event network-vif-plugged-998043fe-d890-43af-9004-360b27f55c36 for instance with vm_state active and task_state None.
May 13 02:20:02.669568 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:02.669637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:02.669767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:02.670255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:02.670255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:02.670255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:02.670394 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:02.670499 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Acquiring lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:02.670633 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:02.671526 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:02.671526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] No waiting events found dispatching network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:02.671526 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f77c302c-8786-4473-b0c7-a999de6e2ec0 req-0ab9e153-241b-4689-af50-8cf0a4445c89 service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-unplugged-1effd6a6-381d-4c92-b42b-ca4eb0f6200f for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:02.674885 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:02.827644 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:02.835486 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638802.833487, 90e1017f-ad0b-497c-aa9c-1e9312587a5d => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:02.835623 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] VM Resumed (Lifecycle Event)
May 13 02:20:02.854865 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Took 15.91 seconds to build instance.
May 13 02:20:03.340050 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:03.342427 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:03.357333 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.416s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:03.400237 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:03.503399 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:03.503571 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:03.844767 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999747761000435 future=<Future at 0x705c6c12d850 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:03.884139 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:03.884528 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:03.902366 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Took 1.35 seconds to deallocate network for instance.
May 13 02:20:04.005585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:20:04.252928 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-changed-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:04.253481 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Refreshing instance network info cache due to event network-changed-998043fe-d890-43af-9004-360b27f55c36. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:04.253719 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] Acquiring lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:04.253849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] Acquired lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:04.254208 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Refreshing network info cache for port 998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:04.412412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:04.412625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:04.576713 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:04.665182 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:04.665425 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:04.726540 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4a67270a-16ec-4b42-9acf-3f1f282cc2db req-3f0d6ea6-2ee5-488d-986e-7644d2c4648b service nova] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Received event network-vif-deleted-1effd6a6-381d-4c92-b42b-ca4eb0f6200f {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:04.756706 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:04.883958 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:04.884935 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:04.885135 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:20:04.887185 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:05.105123 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:05.170464 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:05.235934 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updated VIF entry in instance network info cache for port 998043fe-d890-43af-9004-360b27f55c36. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:20:05.236253 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating instance_info_cache with network_info: [{"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:05.681617 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.269s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:05.683846 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.106s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:05.690127 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:20:05.690127 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Claim successful on node np0000000663
May 13 02:20:05.738224 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-340b7bc9-ce88-4753-92ae-c336904f8f54 req-110ccdf2-b291-43ba-9f0c-9666e37316f5 service nova] Releasing lock "refresh_cache-90e1017f-ad0b-497c-aa9c-1e9312587a5d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:05.742193 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Deleted allocations for instance 75ef4b67-07c0-4399-9d88-d5a6c77207a8
May 13 02:20:05.881490 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:05.881699 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:05.883646 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:05.884675 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:06.084421 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:06.386526 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:06.750922 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-70a9d527-950d-4118-a249-dc49c69f39f2 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "75ef4b67-07c0-4399-9d88-d5a6c77207a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.099s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:06.809609 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Refreshing inventories for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 13 02:20:06.865425 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Updating ProviderTree inventory for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 13 02:20:06.865884 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Updating inventory in ProviderTree for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 13 02:20:06.927565 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Refreshing aggregate associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, aggregates: None {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 13 02:20:06.998677 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Refreshing trait associations for resource provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684, traits: COMPUTE_SOUND_MODEL_ICH9,COMPUTE_ARCH_X86_64,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_CPU_X86_SSE41,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOUND_MODEL_AC97,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_RISCV64,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_SB16,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_ARCH_AARCH64,HW_CPU_X86_MMX,HW_ARCH_X86_64,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_ARCH_MIPSEL,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ARCH_S390X,COMPUTE_STORAGE_BUS_SATA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=98103) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 13 02:20:07.044140 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:07.194565 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:07.194725 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:07.385702 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:07.604647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:07.604843 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:07.604992 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:07.605163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:07.605294 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:07.607399 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Terminating instance
May 13 02:20:07.697158 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:07.896325 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:08.110253 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:20:08.132068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.134756 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.153349 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.157839 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.181394 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.182717 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.203941 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.522s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:08.204750 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:20:08.208712 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.314s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:08.209433 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:08.209611 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:20:08.287047 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:08.287445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:08.287588 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:08.287705 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:08.287812 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] No waiting events found dispatching network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:08.287911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-952fd966-8b22-4bec-ab64-d8d06b2fcbba req-fcb18acb-46ef-48a4-be55-851f5c0703f3 service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:08.458673 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999695723999594 future=<Future at 0x705c6c712930 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:08.461252 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Instance destroyed successfully.
May 13 02:20:08.461755 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lazy-loading 'resources' on Instance uuid 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:08.711210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:20:08.711919 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:20:08.712229 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:08.712473 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:08.787323 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4acc4ee8597744baa14224320669fc51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a3847aeaf9841b199e63d3c1c099c9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:20:08.934690 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0019084709997514437 future=<Future at 0x705c4870d6a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:08.935560 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] Emitting event <LifecycleEvent: 1778638793.9325933, c19374b4-2270-4a5d-ba5c-251d9c52797e => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:08.935792 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:08.936068 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] VM Stopped (Lifecycle Event)
May 13 02:20:08.938748 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.905780579000293 future=<Future at 0x705c6c12d850 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:08.938890 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.905597619000218 future=<Future at 0x705c6c12d850 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:08.964380 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-1455047475',display_name='tempest-instance-1455047475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-instance-1455047475',id=74,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnXJIxCzpSQD1hCjCHD8BxDGA7NY/ISLX2uGf5Yab1k2gQfSoFtY6OrkkOcILBw9v1WJrClz6m9DJQ2bamXcrdE2T7Jp12fyH1Tfc0VqwynEgVssMnXh9X7I1cNNpj/CA==',key_name='tempest-keypair-892570211',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:19:39Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='751d97a0dee94850a5b3deb439648aa6',ramdisk_id='',reservation_id='r-oavwd7vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-645293351',owner_user_name='tempest-VolumesBackupsTest-645293351-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:19:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba655df8e5e48b4b75b0aa4d9c5a68c',uuid=34fc8c7d-d5ce-4052-9dab-27f6741dd3f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:20:08.964590 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converting VIF {"id": "a162fb93-eb04-4d87-bd01-170f5dc59897", "address": "fa:16:3e:0c:d1:87", "network": {"id": "2638b873-a7f3-474d-a99a-6f0b1506bec2", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1815413011-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "751d97a0dee94850a5b3deb439648aa6", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa162fb93-eb", "ovs_interfaceid": "a162fb93-eb04-4d87-bd01-170f5dc59897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:08.965406 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:08.965638 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:20:08.966510 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.966774 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa162fb93-eb, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:08.967760 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.969043 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:08.969865 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.970435 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c2e6d6d-7a5f-4541-9a30-90af50b26264) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:08.973392 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:08.974403 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:08.977560 np0000000663 nova-compute[98103]: INFO os_vif [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:d1:87,bridge_name='br-int',has_traffic_filtering=True,id=a162fb93-eb04-4d87-bd01-170f5dc59897,network=Network(2638b873-a7f3-474d-a99a-6f0b1506bec2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa162fb93-eb')
May 13 02:20:08.982993 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:20:08.982993 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:08.982993 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:09.217397 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:20:09.264837 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.282s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:09.265272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:20:09.266578 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:20:09.293816 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Successfully created port: 1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:20:09.296599 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:09.296599 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:09.296599 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:09.296599 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:09.296599 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:09.296760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsi session list stdout=tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:09.296760 np0000000663 nova-compute[98103]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:09.296760 np0000000663 nova-compute[98103]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:09.296760 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:09.296760 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:09.296968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '210')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:20:09.297168 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '207')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:20:09.298016 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c', '208')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:20:09.298858 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c709760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'): ({'sdk'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:20:09.299122 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Removing multipathed devices sdk, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:20:09.299353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Flush multipath device 330000000650e7ced {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:20:09.356799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:20:09.405982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:20:09.443052 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-555d7121-ad31-467a-9ad7-6e97f2ba8cec tempest-TestEncryptedCinderVolumes-1329189432 tempest-TestEncryptedCinderVolumes-1329189432-project-member] [instance: c19374b4-2270-4a5d-ba5c-251d9c52797e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:09.456225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Checking to see if SCSI volumes sdk, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:20:09.456467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] SCSI volumes sdk, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:20:09.457546 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Checking to see if device paths {'sdk', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:20:09.476548 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Device paths {'sdk', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:20:09.476833 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:20:09.480498 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:20:09.482451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:09.499129 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.534660 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.40.100,3260]
May 13 02:20:09.534660 np0000000663 nova-compute[98103]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.40.100,3260] successful.
May 13 02:20:09.534660 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.549828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.560828 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.592001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.50.100,3260]
May 13 02:20:09.592001 np0000000663 nova-compute[98103]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c, portal: 192.168.50.100,3260] successful.
May 13 02:20:09.592001 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.601265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:09.601979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:09.619015 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:09.619959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:09.620194 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] <== disconnect_volume: return (637ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:09.620390 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:20:09.620842 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Deleting instance files /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3_del
May 13 02:20:09.621509 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Deletion of /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3_del complete
May 13 02:20:09.716910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json" returned: 1 in 0.115s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:09.717112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk --force-share --output=json' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:20:09.719285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:20:09.723544 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000004a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/34fc8c7d-d5ce-4052-9dab-27f6741dd3f3/disk
May 13 02:20:09.729129 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:20:09.730537 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:09.784696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.054s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:09.785026 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=13742MB free_disk=72.71296310424805GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:20:09.785366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:09.785445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:09.891331 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Successfully updated port: 1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:20:09.952695 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-changed-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:09.953900 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Refreshing instance network info cache due to event network-changed-1b2bb339-ef59-437b-9fd4-e2ac09bc8591. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:09.953900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] Acquiring lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:09.953900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] Acquired lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:09.954152 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Refreshing network info cache for port 1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:10.138811 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Took 2.03 seconds to destroy the instance on the hypervisor.
May 13 02:20:10.138811 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:20:10.138950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:20:10.138984 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:20:10.139363 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:10.172518 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:10.232876 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:10.354118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:10.354118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] Acquiring lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:10.354688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:10.355033 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:10.355686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] No waiting events found dispatching network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:10.355686 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-50545533-b64a-4e86-a8e0-96c705a1ff74 req-6859ac16-bce1-4257-a427-7bdb643e25cc service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-unplugged-a162fb93-eb04-4d87-bd01-170f5dc59897 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:10.393289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:10.456371 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:10.558327 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:10.720056 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f9a95743-f04c-44ac-9ada-66971fdb6958 req-a52b93c4-93c1-4678-95b8-9e8196db240e service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Received event network-vif-deleted-a162fb93-eb04-4d87-bd01-170f5dc59897 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:10.720288 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-f9a95743-f04c-44ac-9ada-66971fdb6958 req-a52b93c4-93c1-4678-95b8-9e8196db240e service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Neutron deleted interface a162fb93-eb04-4d87-bd01-170f5dc59897; detaching it from the instance and deleting it from the info cache
May 13 02:20:10.720503 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f9a95743-f04c-44ac-9ada-66971fdb6958 req-a52b93c4-93c1-4678-95b8-9e8196db240e service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:10.736505 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:20:10.738580 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:20:10.738580 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Creating image(s)
May 13 02:20:10.739122 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:10.739703 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:10.740741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:10.743685 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:10.752919 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:10.755504 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:10.779475 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:10.807986 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:10.807986 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:10.848896 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:20:10.848896 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 90e1017f-ad0b-497c-aa9c-1e9312587a5d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:20:10.848896 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0456364e-fbd2-4f95-a603-ae758aec59f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:20:10.855426 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.100s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:10.855785 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:10.856288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:10.856656 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:10.859415 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:10.859708 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:10.946340 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:10.946810 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:11.005567 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk 1073741824" returned: 0 in 0.058s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:11.006004 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:11.006379 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:11.086496 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:11.114011 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.107s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:11.114589 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:20:11.114850 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:11.159367 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:11.161113 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:11.161423 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:11.203300 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:11.203658 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Cannot resize image /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:20:11.203998 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:20:11.204202 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Ensure instance console log exists: /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:20:11.204491 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:11.204673 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:11.204849 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:11.231777 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f9a95743-f04c-44ac-9ada-66971fdb6958 req-a52b93c4-93c1-4678-95b8-9e8196db240e service nova] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Detach interface failed, port_id=a162fb93-eb04-4d87-bd01-170f5dc59897, reason: Instance 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:20:11.283787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-654142d7-4ae5-4a65-9c37-ad60d43ad1ba req-6f08973d-0707-4d65-9a9f-386ed63eb4b7 service nova] Releasing lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:11.285378 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquired lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:11.285378 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:20:11.309371 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:20:11.351495 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5f2a891b-623d-4145-b997-285c23394f55 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 02:20:11.668161 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:20:11.670280 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Took 1.53 seconds to deallocate network for instance.
May 13 02:20:11.853181 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e2be1263-ac67-49fb-a8b7-17c80b5c534b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 13 02:20:11.853461 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:20:11.854311 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:20:09 up 44 min,  2 users,  load average: 4.83, 6.15, 5.25\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '3', 'num_proj_751d97a0dee94850a5b3deb439648aa6': '1', 'io_workload': '1', 'num_task_None': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_7a3847aeaf9841b199e63d3c1c099c9f': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:20:11.859649 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:11.874118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:12.027493 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:12.178447 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updating instance_info_cache with network_info: [{"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:12.233974 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:12.237728 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Took 0.57 seconds to detach 1 volumes for instance.
May 13 02:20:12.245888 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:12.246116 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:12.681637 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Releasing lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:12.682152 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance network_info: |[{"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:20:12.683844 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Start _get_guest_xml network_info=[{"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:20:12.687313 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:20:12.688489 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-709302027', uuid='0456364e-fbd2-4f95-a603-ae758aec59f8'), owner=OwnerMeta(userid='4acc4ee8597744baa14224320669fc51', username='tempest-VolumeMultiattachTests-932012962-project-member', projectid='7a3847aeaf9841b199e63d3c1c099c9f', projectname='tempest-VolumeMultiattachTests-932012962'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638812.6881306) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:20:12.689649 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:20:12.689938 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:20:12.690962 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:20:12.691172 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:20:12.691981 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:20:12.692348 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:20:12.692506 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:20:12.692601 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:20:12.692712 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:20:12.692788 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:20:12.692871 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:20:12.693008 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:20:12.693159 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:20:12.693263 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:20:12.693358 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:20:12.693467 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:20:12.703995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-709302027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-709302027',id=76,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuZfZGNukLk2T85qz2GrrQLra93aTvnOayjz0ZQeUbuZsMMSo6iXhlBi5ftysRr6CG6DMwJP3YPVTEDuN1bjIE7/ENolF2NJ0jUFbXbj9qBCoCRmafxJ013ByCYv3uyuQ==',key_name='tempest-keypair-1339523636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-e7xnvwxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=0456364e-fbd2-4f95-a603-ae758aec59f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:20:12.704180 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:12.704725 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:12.705236 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'pci_devices' on Instance uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:12.745268 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:12.749647 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:13.208254 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] End _get_guest_xml xml=<domain type="qemu">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <uuid>0456364e-fbd2-4f95-a603-ae758aec59f8</uuid>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <name>instance-0000004c</name>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:name>tempest-VolumeMultiattachTests-server-709302027</nova:name>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:20:12</nova:creationTime>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:user uuid="4acc4ee8597744baa14224320669fc51">tempest-VolumeMultiattachTests-932012962-project-member</nova:user>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:project uuid="7a3847aeaf9841b199e63d3c1c099c9f">tempest-VolumeMultiattachTests-932012962</nova:project>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         <nova:port uuid="1b2bb339-ef59-437b-9fd4-e2ac09bc8591">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <system>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="serial">0456364e-fbd2-4f95-a603-ae758aec59f8</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="uuid">0456364e-fbd2-4f95-a603-ae758aec59f8</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </system>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <os>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </os>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <features>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </features>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   <devices>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.config"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:01:50:67"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <target dev="tap1b2bb339-ef"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </interface>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/console.log" append="off"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </serial>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <video>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </video>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </rng>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:   </devices>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]: </domain>
May 13 02:20:13.208254 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Preparing to wait for external event network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-709302027',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-709302027',id=76,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuZfZGNukLk2T85qz2GrrQLra93aTvnOayjz0ZQeUbuZsMMSo6iXhlBi5ftysRr6CG6DMwJP3YPVTEDuN1bjIE7/ENolF2NJ0jUFbXbj9qBCoCRmafxJ013ByCYv3uyuQ==',key_name='tempest-keypair-1339523636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-e7xnvwxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=0456364e-fbd2-4f95-a603-ae758aec59f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:13.210191 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:13.210474 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:20:13.210652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.211129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:13.211505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:20:13.212049 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.212246 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bac69c0-8293-5a68-aafc-eeaa8a4e6e0d', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:13.213022 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.213743 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:13.215416 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.215568 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b2bb339-ef, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:13.215873 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b2bb339-ef, col_values=(('qos', UUID('6a7eee65-938b-4932-a9bf-8321823b607f')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:13.216035 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b2bb339-ef, col_values=(('external_ids', {'iface-id': '1b2bb339-ef59-437b-9fd4-e2ac09bc8591', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:50:67', 'vm-uuid': '0456364e-fbd2-4f95-a603-ae758aec59f8'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:13.216945 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.218141 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:13.222548 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:13.223352 np0000000663 nova-compute[98103]: INFO os_vif [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef')
May 13 02:20:13.257964 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:20:13.258202 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.473s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:13.258674 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.385s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:13.259008 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:13.259256 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Cleaning up deleted instances with incomplete migration  {{(pid=98103) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 13 02:20:13.263670 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:20:13.263828 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Claim successful on node np0000000663
May 13 02:20:13.761450 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 29.25 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:14.517314 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:14.517531 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:14.737519 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:14.737635 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:14.737693 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:01:50:67, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:20:14.738084 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Using config drive
May 13 02:20:15.019808 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:15.243802 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:15.354087 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Creating config drive at /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.config
May 13 02:20:15.357734 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp08lxx18o {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:15.412696 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp08lxx18o" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:15.526690 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.268s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:15.527542 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.294s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:15.527763 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:20:15.536214 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:20:15.536330 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Claim successful on node np0000000663
May 13 02:20:15.812126 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:15.838359 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:15.842383 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:15.930084 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:15.991522 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef8c23a3-08ac-4989-a227-b4c35af7462d req-f91c51b7-47d4-482c-80e2-200525c2f829 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:15.996114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef8c23a3-08ac-4989-a227-b4c35af7462d req-f91c51b7-47d4-482c-80e2-200525c2f829 service nova] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:15.996114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef8c23a3-08ac-4989-a227-b4c35af7462d req-f91c51b7-47d4-482c-80e2-200525c2f829 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:15.996114 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-ef8c23a3-08ac-4989-a227-b4c35af7462d req-f91c51b7-47d4-482c-80e2-200525c2f829 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:15.996114 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-ef8c23a3-08ac-4989-a227-b4c35af7462d req-f91c51b7-47d4-482c-80e2-200525c2f829 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Processing event network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:20:16.038966 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:20:16.038966 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:20:16.038966 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:16.038966 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:16.087185 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:16.132498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:16.134929 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:16.138140 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b8270e949dc4210bf691de82ed07e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad986512b43843d28a756102ac971343', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:20:16.140533 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:16.158342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:16.544901 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:20:16.575016 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Successfully created port: fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:20:16.624440 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638816.6239662, 0456364e-fbd2-4f95-a603-ae758aec59f8 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:16.624688 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] VM Started (Lifecycle Event)
May 13 02:20:16.626227 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:20:16.628479 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:20:16.630654 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance spawned successfully.
May 13 02:20:16.630908 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:20:16.824344 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:16.824561 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:17.051120 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:20:17.127960 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:17.130169 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:17.136680 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.136841 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.137229 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.137524 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.137854 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.138196 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:17.327179 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:17.571903 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Successfully updated port: fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:20:17.634512 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:20:17.634765 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638817.634593, 0456364e-fbd2-4f95-a603-ae758aec59f8 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:17.634906 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] VM Paused (Lifecycle Event)
May 13 02:20:17.642998 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Took 6.91 seconds to spawn the instance on the hypervisor.
May 13 02:20:17.643198 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:17.835732 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.309s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:17.836411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.091s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:17.836625 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] No waiting events found dispatching network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received unexpected event network-vif-plugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 for instance with vm_state active and task_state None.
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing instance network info cache due to event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:18.056255 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:18.067775 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:20:18.068623 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:20:18.068988 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Creating image(s)
May 13 02:20:18.069498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:18.069701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:18.070237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:18.070477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:18.070793 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:18.079545 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:18.120596 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:18.120784 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:18.137648 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:18.141122 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638818.1407902, 0456364e-fbd2-4f95-a603-ae758aec59f8 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:18.141239 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] VM Resumed (Lifecycle Event)
May 13 02:20:18.155933 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Took 13.64 seconds to build instance.
May 13 02:20:18.217642 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:18.348953 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:20:18.348953 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:20:18.348953 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:18.349236 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:18.449518 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c20465c49104552b6af116f9e0c14d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57dfe4c819c84128b0149ebe05ecf5be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:20:18.559364 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:18.607968 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:18.613028 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:18.613797 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.part --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:18.637044 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:18.645849 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:18.654298 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:18.669172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-93aa356f-5497-4c19-ae05-3e3cb8333d70 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.160s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:18.671335 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:18.712828 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.part --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:18.713400 np0000000663 nova-compute[98103]: DEBUG nova.virt.images [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] 773c7e22-9fa4-49e7-ba57-fc0315ab306c was qcow2, converting to raw {{(pid=98103) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 13 02:20:18.713974 np0000000663 nova-compute[98103]: DEBUG nova.privsep.utils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98103) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 13 02:20:18.714320 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.part /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.converted {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0032373549997828377 future=<Future at 0x705c6c12d850 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.610402452000017 future=<Future at 0x705c6c712930 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=4.610228238999753 future=<Future at 0x705c6c712930 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Emitting event <LifecycleEvent: 1778638803.844409, 75ef4b67-07c0-4399-9d88-d5a6c77207a8 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] VM Stopped (Lifecycle Event)
May 13 02:20:18.859535 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:20:18.942168 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.part /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.converted" returned: 0 in 0.228s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:18.947759 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.converted --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.044145 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.044991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.974s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:19.045522 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:19.048873 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Successfully created port: 4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:20:19.054844 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:19.055994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.175389 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.339s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:19.181260 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-changed-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:19.183299 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Refreshing instance network info cache due to event network-changed-1b2bb339-ef59-437b-9fd4-e2ac09bc8591. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:19.183485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] Acquiring lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:19.183579 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] Acquired lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:19.183927 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json" returned: 0 in 0.126s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.184374 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Refreshing network info cache for port 1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:19.185824 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:19.186561 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:19.186955 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:19.189584 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:20:19.189945 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.255687 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Deleted allocations for instance 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3
May 13 02:20:19.282887 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json" returned: 0 in 0.093s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.283358 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95,backing_fmt=raw /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.348743 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95,backing_fmt=raw /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk 1073741824" returned: 0 in 0.065s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.349263 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "2017c047946684b1fa73bc0044cb11a2dbda1d95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.163s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:19.349639 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.366968 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:20:19.376199 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-4d7c160c-b320-4af7-be9c-c62dda8b1979 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 75ef4b67-07c0-4399-9d88-d5a6c77207a8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:19.376893 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f3a7e50c-317a-4b2c-b185-cfb3fb968759 req-1b8a64e1-83cd-42cb-9014-c53dda7aa5df service nova] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:19.379497 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:19.380567 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:20:19.440344 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2017c047946684b1fa73bc0044cb11a2dbda1d95 --force-share --output=json" returned: 0 in 0.091s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.440953 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:20:19.440953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:19.531461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Cannot resize image /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Ensure instance console log exists: /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:19.535025 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:19.549521 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Successfully updated port: 4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:20:19.608607 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-changed-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:19.609013 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Refreshing instance network info cache due to event network-changed-4a11b2f3-af19-4c7b-8158-e0285420e241. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:19.609251 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] Acquiring lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:19.610413 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] Acquired lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:19.610606 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Refreshing network info cache for port 4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:19.690900 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:19.883881 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Booting with volume 10d55471-f748-4a3c-bf91-e75c04bacda8 at /dev/vda
May 13 02:20:19.932230 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:19.949170 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:20:19.978115 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:20.019117 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:20.023158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:20:20.023558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:20:20.029995 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe97:7556', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe01:5067', 'fe80::2813:28ff:fee9:663e'] 
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:20.038116 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating existing volume attachment record: 7ce131a5-0331-4cd1-b4d1-30e4213ed5be {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:20:20.052249 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:20.112994 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:20.202315 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:20.219310 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updated VIF entry in instance network info cache for port 1b2bb339-ef59-437b-9fd4-e2ac09bc8591. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:20:20.219599 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updating instance_info_cache with network_info: [{"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:20.233877 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:20.268017 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-df0b3205-8b3a-4528-8b40-6a27a3885b97 tempest-VolumesBackupsTest-645293351 tempest-VolumesBackupsTest-645293351-project-member] Lock "34fc8c7d-d5ce-4052-9dab-27f6741dd3f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.663s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:20.338298 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:20.370165 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:20.721774 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7cc446d3-d259-4231-b50a-c34dc5357ad9 req-61882ac5-72f7-42bd-be11-febf2e2c1928 service nova] Releasing lock "refresh_cache-0456364e-fbd2-4f95-a603-ae758aec59f8" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:20.840470 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d67c8660-08a1-483b-87cc-38d471a91520 req-90bf2aab-9a9c-4350-8e7b-af0f3a9f2af4 service nova] Releasing lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:20.841228 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquired lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:20.841228 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:20:20.872985 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:20.872985 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance network_info: |[{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:20:20.873847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Start _get_guest_xml network_info=[{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:20:08Z,direct_url=<?>,disk_format='qcow2',id=773c7e22-9fa4-49e7-ba57-fc0315ab306c,min_disk=0,min_ram=0,name='tempest-scenario-img--398859530',owner='ad986512b43843d28a756102ac971343',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:20:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': '773c7e22-9fa4-49e7-ba57-fc0315ab306c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:20:20.879374 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:20:20.880597 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='773c7e22-9fa4-49e7-ba57-fc0315ab306c', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-219971270', uuid='5f2a891b-623d-4145-b997-285c23394f55'), owner=OwnerMeta(userid='5b8270e949dc4210bf691de82ed07e0d', username='tempest-TestMinimumBasicScenario-1453218982-project-member', projectid='ad986512b43843d28a756102ac971343', projectname='tempest-TestMinimumBasicScenario-1453218982'), image=ImageMeta(id='773c7e22-9fa4-49e7-ba57-fc0315ab306c', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638820.880175) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:20:20.884655 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:20:20.884977 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:20:20.886110 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:20:20.886266 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:20:20.887209 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:20:20.887493 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:20:08Z,direct_url=<?>,disk_format='qcow2',id=773c7e22-9fa4-49e7-ba57-fc0315ab306c,min_disk=0,min_ram=0,name='tempest-scenario-img--398859530',owner='ad986512b43843d28a756102ac971343',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:20:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:20:20.887628 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:20:20.887691 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:20:20.887815 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:20:20.887890 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:20:20.887982 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:20:20.888181 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:20:20.888281 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:20:20.888401 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:20:20.888499 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:20:20.888611 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:20:20.899139 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219971270',display_name='tempest-TestMinimumBasicScenario-server-219971270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-219971270',id=77,image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAw4h6HP7oliTV3o7zQ3lGGkNUw4Sa7ivbunF/2RD8+DYwf7et3r3EzUjn6BRXJgwxFcPGuOPzfgwW0xtUUM3Ii0Vk+MVdjBzRcaNtzFXlj+wN8JNo1WIc9jEtL4NLpW3A==',key_name='tempest-TestMinimumBasicScenario-1328816159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-2kvnp4ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:17Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=5f2a891b-623d-4145-b997-285c23394f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:20:20.899322 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:20.899817 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:20.900442 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:21.099664 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.404823 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] End _get_guest_xml xml=<domain type="qemu">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <uuid>5f2a891b-623d-4145-b997-285c23394f55</uuid>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <name>instance-0000004d</name>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestMinimumBasicScenario-server-219971270</nova:name>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:20:20</nova:creationTime>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:image uuid="773c7e22-9fa4-49e7-ba57-fc0315ab306c">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:properties/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:user uuid="5b8270e949dc4210bf691de82ed07e0d">tempest-TestMinimumBasicScenario-1453218982-project-member</nova:user>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:project uuid="ad986512b43843d28a756102ac971343">tempest-TestMinimumBasicScenario-1453218982</nova:project>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="773c7e22-9fa4-49e7-ba57-fc0315ab306c"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         <nova:port uuid="fdb3d263-13d4-4da8-b476-a57c8f8d5685">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <system>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="serial">5f2a891b-623d-4145-b997-285c23394f55</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="uuid">5f2a891b-623d-4145-b997-285c23394f55</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </system>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <os>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </os>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <features>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </features>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   <devices>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.config"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:50:22:ae"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <target dev="tapfdb3d263-13"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </interface>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/console.log" append="off"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </serial>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <video>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </video>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </rng>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:   </devices>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]: </domain>
May 13 02:20:21.404823 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Preparing to wait for external event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219971270',display_name='tempest-TestMinimumBasicScenario-server-219971270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-219971270',id=77,image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAw4h6HP7oliTV3o7zQ3lGGkNUw4Sa7ivbunF/2RD8+DYwf7et3r3EzUjn6BRXJgwxFcPGuOPzfgwW0xtUUM3Ii0Vk+MVdjBzRcaNtzFXlj+wN8JNo1WIc9jEtL4NLpW3A==',key_name='tempest-TestMinimumBasicScenario-1328816159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-2kvnp4ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:17Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=5f2a891b-623d-4145-b997-285c23394f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7468e188-3679-5d68-919f-c146a3a6ba43', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdb3d263-13, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdb3d263-13, col_values=(('qos', UUID('9085e432-ad9a-4050-8df9-4f13a0457e79')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdb3d263-13, col_values=(('external_ids', {'iface-id': 'fdb3d263-13d4-4da8-b476-a57c8f8d5685', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:22:ae', 'vm-uuid': '5f2a891b-623d-4145-b997-285c23394f55'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.418576 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:21.422163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:21.422163 np0000000663 nova-compute[98103]: INFO os_vif [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13')
May 13 02:20:21.431329 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:21.605891 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:21.739296 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating instance_info_cache with network_info: [{"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:22.170811 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:20:22.171860 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:20:22.171860 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Creating image(s)
May 13 02:20:22.172463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:20:22.172463 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Ensure instance console log exists: /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:20:22.172463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:22.172463 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:22.172960 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:22.241174 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Releasing lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:22.241611 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance network_info: |[{"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:20:22.242225 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Start _get_guest_xml network_info=[{"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e2be1263-ac67-49fb-a8b7-17c80b5c534b', 'attached_at': '', 'detached_at': '', 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'serial': '10d55471-f748-4a3c-bf91-e75c04bacda8'}, 'attachment_id': '7ce131a5-0331-4cd1-b4d1-30e4213ed5be', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:20:22.244705 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:20:22.245812 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-156343259', uuid='e2be1263-ac67-49fb-a8b7-17c80b5c534b'), owner=OwnerMeta(userid='7c20465c49104552b6af116f9e0c14d5', username='tempest-TestEncryptedCinderVolumes-368552408-project-member', projectid='57dfe4c819c84128b0149ebe05ecf5be', projectname='tempest-TestEncryptedCinderVolumes-368552408'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638822.245388) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:20:22.247076 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:20:22.247692 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:20:22.248453 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:20:22.249002 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:20:22.249539 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:20:22.249584 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:20:22.249850 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:20:22.249850 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:20:22.250460 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:20:22.251060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:20:22.251060 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:20:22.260981 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:20:22.260981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:22.261119 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:22.261693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:22.261693 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:20:22.275010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:22.275738 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:22.276419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:22.276419 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:22.277052 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:22.277052 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:22.288253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:22.288253 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:22.293684 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:22.293684 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:22.299779 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8] added
May 13 02:20:22.299779 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:22.299779 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:22.299779 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:22.299779 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:22.299779 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:22.299779 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:22.299957 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:22.300152 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:22.300310 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:22.302869 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8] added
May 13 02:20:22.302869 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:22.302869 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:22.302869 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:22.302869 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:22.302869 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:22.302869 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:22.302991 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:22.303178 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:22.303298 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:22.952403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:22.952403 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:22.953375 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No VIF found with MAC fa:16:3e:50:22:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:20:22.953375 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Using config drive
May 13 02:20:23.300699 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:23.303709 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:23.313998 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:23.313998 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:23.320153 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:23.320153 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.326360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.332249 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.337253 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.337253 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.337253 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.337253 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:23.337467 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.337467 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.337467 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.337467 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:23.345731 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.345731 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.345731 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.345731 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:23.346874 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.346874 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.346874 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.346874 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:23.386472 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.50.100,3260]
May 13 02:20:23.386472 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.50.100,3260] successful.
May 13 02:20:23.386472 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.398760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.40.100,3260]
May 13 02:20:23.398760 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.40.100,3260] successful.
May 13 02:20:23.398760 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.406511 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.413701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:23.426411 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.426411 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.426411 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.426411 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.426411 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.426411 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.426724 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:23.426724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:23.427468 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:23.427588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('10', '-', '-', 0) found on session 214 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:23.427702 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77f19c55-6ba6-4b9b-8bf0-9f48395b2f7c (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:23.432954 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:23.433476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:23.433476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:23.434021 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] HCTL ('11', '-', '-', 0) found on session 215 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:23.434021 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:23.456434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 214 and hctl ['10', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:23.456434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 215 and hctl ['11', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:23.459190 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:23.462028 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0036045230003765028 future=<Future at 0x705c6c712930 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:23.463414 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:23.463765 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638808.4582767, 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:23.464539 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] VM Stopped (Lifecycle Event)
May 13 02:20:23.625104 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Creating config drive at /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.config
May 13 02:20:23.628688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqt6sp6so {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:23.689515 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqt6sp6so" returned: 0 in 0.060s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:23.969821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 34fc8c7d-d5ce-4052-9dab-27f6741dd3f3] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:24.121451 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.155718 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.240995 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.326430 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d37d268-2f33-4e46-8e91-52a0eedef43e req-b9c1e359-fb72-4e61-a9ec-695699e5099a service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:24.326763 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d37d268-2f33-4e46-8e91-52a0eedef43e req-b9c1e359-fb72-4e61-a9ec-695699e5099a service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:24.329969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d37d268-2f33-4e46-8e91-52a0eedef43e req-b9c1e359-fb72-4e61-a9ec-695699e5099a service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:24.330947 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-3d37d268-2f33-4e46-8e91-52a0eedef43e req-b9c1e359-fb72-4e61-a9ec-695699e5099a service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:24.331210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-3d37d268-2f33-4e46-8e91-52a0eedef43e req-b9c1e359-fb72-4e61-a9ec-695699e5099a service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Processing event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:20:24.446169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 214 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:24.446341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:24.446761 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.447890 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.450659 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.451743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Searching for a device in session 215 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:24.451743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:24.469925 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:24.886213 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638824.8858144, 5f2a891b-623d-4145-b997-285c23394f55 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:24.886765 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:20:24.888396 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Started (Lifecycle Event)
May 13 02:20:24.889162 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:20:24.894080 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance spawned successfully.
May 13 02:20:24.894425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:20:25.277754 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:20:25.393707 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:25.395378 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:25.403883 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.404078 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.404537 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.404859 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.405265 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.405601 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:25.900469 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:20:25.900469 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638825.8993292, 5f2a891b-623d-4145-b997-285c23394f55 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:25.900469 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Paused (Lifecycle Event)
May 13 02:20:25.910994 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Took 7.84 seconds to spawn the instance on the hypervisor.
May 13 02:20:25.911177 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:26.101270 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:26.296699 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Found WWN 33000000008e9e043 for multipath device dm-6 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:20:26.297080 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.036s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:26.298140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== connect_volume: return (4037ms) {'type': 'block', 'scsi_wwn': '33000000008e9e043', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000008e9e043'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:26.298306 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000008e9e043', 'path': '/dev/disk/by-id/os-brick+dev+dm-6', 'multipath_id': '33000000008e9e043'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:20:26.332165 np0000000663 nova-compute[98103]: DEBUG os_brick.encryptors [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, 'status': 'reserved', 'instance': 'e2be1263-ac67-49fb-a8b7-17c80b5c534b', 'attached_at': '', 'detached_at': '', 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'serial': '10d55471-f748-4a3c-bf91-e75c04bacda8'} {{(pid=98103) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 13 02:20:26.332836 np0000000663 nova-compute[98103]: WARNING stevedore.named [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 13 02:20:26.333066 np0000000663 nova-compute[98103]: WARNING castellan.key_manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:20:26.333366 np0000000663 nova-compute[98103]: WARNING nova.keymgr.conf_key_mgr [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 13 02:20:26.347087 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Secret XML: <secret ephemeral="no" private="no">
May 13 02:20:26.347087 np0000000663 nova-compute[98103]:   <usage type="volume">
May 13 02:20:26.347087 np0000000663 nova-compute[98103]:     <volume>10d55471-f748-4a3c-bf91-e75c04bacda8</volume>
May 13 02:20:26.347087 np0000000663 nova-compute[98103]:   </usage>
May 13 02:20:26.347087 np0000000663 nova-compute[98103]: </secret>
May 13 02:20:26.347087 np0000000663 nova-compute[98103]:  {{(pid=98103) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 13 02:20:26.380148 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:26.380148 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:26.380148 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:26.380482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:26.380482 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:26.380482 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-28cb5bf7-1b7c-442d-adaa-b3ad3072226a req-63ea9faf-e871-4e95-aedb-a2a03588eb1d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received unexpected event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with vm_state active and task_state None.
May 13 02:20:26.401972 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:26.407923 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638826.4064713, 5f2a891b-623d-4145-b997-285c23394f55 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:26.408166 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Resumed (Lifecycle Event)
May 13 02:20:26.414754 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:26.420897 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Took 14.61 seconds to build instance.
May 13 02:20:26.854827 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-156343259',display_name='tempest-TestEncryptedCinderVolumes-server-156343259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-156343259',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-1488grj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:19Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=e2be1263-ac67-49fb-a8b7-17c80b5c534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:20:26.855056 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:26.855737 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:26.857747 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'pci_devices' on Instance uuid e2be1263-ac67-49fb-a8b7-17c80b5c534b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:26.910692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:26.914726 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:26.922110 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.115s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:27.360765 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] End _get_guest_xml xml=<domain type="qemu">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <uuid>e2be1263-ac67-49fb-a8b7-17c80b5c534b</uuid>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <name>instance-0000004e</name>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-156343259</nova:name>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:20:22</nova:creationTime>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:user uuid="7c20465c49104552b6af116f9e0c14d5">tempest-TestEncryptedCinderVolumes-368552408-project-member</nova:user>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:project uuid="57dfe4c819c84128b0149ebe05ecf5be">tempest-TestEncryptedCinderVolumes-368552408</nova:project>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <nova:port uuid="4a11b2f3-af19-4c7b-8158-e0285420e241">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <system>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="serial">e2be1263-ac67-49fb-a8b7-17c80b5c534b</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="uuid">e2be1263-ac67-49fb-a8b7-17c80b5c534b</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </system>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <os>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </os>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <features>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </features>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   <devices>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/disk.config"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <alias name="ua-10d55471-f748-4a3c-bf91-e75c04bacda8"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-6"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <serial>10d55471-f748-4a3c-bf91-e75c04bacda8</serial>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <encryption format="luks">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:         <secret type="passphrase" uuid="05c743bd-9119-439c-9876-3310500c1465"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       </encryption>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </disk>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:f2:8c:b9"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <target dev="tap4a11b2f3-af"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </interface>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/console.log" append="off"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </serial>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <video>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </video>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </rng>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:   </devices>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]: </domain>
May 13 02:20:27.360765 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Preparing to wait for external event network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-156343259',display_name='tempest-TestEncryptedCinderVolumes-server-156343259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-156343259',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-1488grj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:19Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=e2be1263-ac67-49fb-a8b7-17c80b5c534b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:27.363171 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:27.363478 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:20:27.363855 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:27.364164 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:27.364411 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:20:27.365224 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:27.365432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf4e7baa-17f2-550f-ba92-6e7080923a8b', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:27.366441 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:27.367567 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:27.369448 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:27.369625 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a11b2f3-af, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:27.369936 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a11b2f3-af, col_values=(('qos', UUID('e7d56a3d-4ffc-4dd6-845d-6d388e6705e8')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:27.370179 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a11b2f3-af, col_values=(('external_ids', {'iface-id': '4a11b2f3-af19-4c7b-8158-e0285420e241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:8c:b9', 'vm-uuid': 'e2be1263-ac67-49fb-a8b7-17c80b5c534b'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:27.372013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:27.376102 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:27.376723 np0000000663 nova-compute[98103]: INFO os_vif [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af')
May 13 02:20:28.382665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:28.382944 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:28.885618 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:28.899337 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:28.899586 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:28.899683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] No VIF found with MAC fa:16:3e:f2:8c:b9, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:20:28.900181 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Using config drive
May 13 02:20:29.409195 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:29.529133 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Creating config drive at /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/disk.config
May 13 02:20:29.532078 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpffvc84h6 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:29.587339 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpffvc84h6" returned: 0 in 0.055s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:20:29.890925 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:29.981818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.010339 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.119918 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.198578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-51ad2ca4-b160-4b77-ac89-4667b6304906 req-deacdf59-db30-4a9a-9b74-eb867ad048a4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:30.198578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-51ad2ca4-b160-4b77-ac89-4667b6304906 req-deacdf59-db30-4a9a-9b74-eb867ad048a4 service nova] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:30.198578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-51ad2ca4-b160-4b77-ac89-4667b6304906 req-deacdf59-db30-4a9a-9b74-eb867ad048a4 service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:30.198578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-51ad2ca4-b160-4b77-ac89-4667b6304906 req-deacdf59-db30-4a9a-9b74-eb867ad048a4 service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:30.198578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-51ad2ca4-b160-4b77-ac89-4667b6304906 req-deacdf59-db30-4a9a-9b74-eb867ad048a4 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Processing event network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:20:30.315413 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.319830 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.323046 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.324337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:30.353913 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:31.046747 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:31.047241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:31.047241 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Attaching volume 9a329b21-04fa-4b76-8523-1d5d51104e5b to /dev/vdb
May 13 02:20:31.094236 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:31.103054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:31.108130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:20:31.131895 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:31.180622 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:20:31.181074 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:20:31.190155 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:20:31.191243 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe97:7556', 'fe80::7ce0:14ff:fe99:c075', 'fe80::fc16:3eff:fe01:5067', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe50:22ae', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fef2:8cb9', 'fe80::9cba:3bff:fe2a:a965'] 
May 13 02:20:31.191380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:20:31.191474 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:20:31.191734 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:31.192017 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating existing volume attachment record: d7dc6c84-931c-4f15-bc86-50b1f9a2cea5 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:20:31.755895 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:20:31.756285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:31.756555 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:31.756958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:31.757189 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:20:31.770778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:31.771654 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:31.771899 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:31.772171 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:31.773222 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:31.773222 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:31.784218 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:31.784218 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:31.789024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:31.789024 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:31.798686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b] added
May 13 02:20:31.798686 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:31.798686 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:31.798686 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:31.798686 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:31.798686 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:31.798686 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:31.798916 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:31.799074 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:31.799299 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b] added
May 13 02:20:31.805570 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:31.805570 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0324(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:31.805570 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:31.808694 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638831.8082638, e2be1263-ac67-49fb-a8b7-17c80b5c534b => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:31.809501 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] VM Started (Lifecycle Event)
May 13 02:20:31.811361 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:20:31.814054 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:20:31.818889 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance spawned successfully.
May 13 02:20:31.819302 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:20:32.258776 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:32.259690 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:32.260434 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:32.260687 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:32.260936 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] No waiting events found dispatching network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:32.261419 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b1804e23-f3c2-41e1-9125-c319ab7060ec req-4a588766-e913-4502-93fb-770f4e72d58d service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received unexpected event network-vif-plugged-4a11b2f3-af19-4c7b-8158-e0285420e241 for instance with vm_state building and task_state spawning.
May 13 02:20:32.313385 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:32.315892 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:32.327517 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.327679 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.328053 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.328323 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.328588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.328851 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:20:32.372738 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:32.799729 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:32.805966 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:32.812612 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:32.812612 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.819519 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:20:32.819889 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638832.8197286, e2be1263-ac67-49fb-a8b7-17c80b5c534b => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:32.819990 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] VM Paused (Lifecycle Event)
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:32.822037 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:32.822037 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.831118 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.834434 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Took 10.66 seconds to spawn the instance on the hypervisor.
May 13 02:20:32.834973 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:32.839831 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.847776 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.847776 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.847776 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.847776 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.847776 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:32.848017 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.848017 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.848017 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.848017 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.848017 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.863966 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:32.894797 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.40.100,3260]
May 13 02:20:32.894797 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.40.100,3260] successful.
May 13 02:20:32.894797 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.909350 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.50.100,3260]
May 13 02:20:32.909350 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.50.100,3260] successful.
May 13 02:20:32.909350 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.910663 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.922951 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.930115 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.930367 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:32.930572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:32.930646 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:32.931367 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('9', '-', '-', 0) found on session 216 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:32.931458 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:32.941584 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:32.941584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:32.949678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] HCTL ('12', '-', '-', 0) found on session 217 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:32.949678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:32.955023 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 216 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:32.955133 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:32.965453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Searching for a device in session 217 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:32.965453 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:33.323016 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:33.325254 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638833.3250139, e2be1263-ac67-49fb-a8b7-17c80b5c534b => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:33.325389 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] VM Resumed (Lifecycle Event)
May 13 02:20:33.346925 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Took 21.17 seconds to build instance.
May 13 02:20:33.773587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:20:33.827374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:33.829401 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:20:33.848311 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e6a6c5cd-eafa-4d3b-ba6b-a0d4e78bb486 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.687s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:34.792213 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found WWN 330000000072c6bd9 for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:20:34.792581 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:34.792581 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000072c6bd9', 'path': '/dev/dm-3', 'multipath_id': '330000000072c6bd9'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:34.792866 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000072c6bd9', 'path': '/dev/dm-3', 'multipath_id': '330000000072c6bd9'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:20:34.795259 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:35.294667 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-changed-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:35.296511 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Refreshing instance network info cache due to event network-changed-4a11b2f3-af19-4c7b-8158-e0285420e241. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:35.296688 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] Acquiring lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:35.296775 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] Acquired lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:35.296890 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Refreshing network info cache for port 4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:35.299393 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Attempting to attach volume 9a329b21-04fa-4b76-8523-1d5d51104e5b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:20:35.301852 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:   <alias name="ua-9a329b21-04fa-4b76-8523-1d5d51104e5b"/>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:   <serial>9a329b21-04fa-4b76-8523-1d5d51104e5b</serial>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]: </disk>
May 13 02:20:35.301852 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:20:35.800437 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:36.088680 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:36.119024 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:36.218463 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updated VIF entry in instance network info cache for port 4a11b2f3-af19-4c7b-8158-e0285420e241. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:20:36.218720 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating instance_info_cache with network_info: [{"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:36.720791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a1900b74-2853-46e5-bb0c-59fa0591ac33 req-8c122851-64a0-4376-93ad-5c47c6304ab1 service nova] Releasing lock "refresh_cache-e2be1263-ac67-49fb-a8b7-17c80b5c534b" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:36.953360 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:36.953788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:36.953788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:20:36.953890 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] No VIF found with MAC fa:16:3e:50:22:ae, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:20:37.374589 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:38.520627 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-46b4a3e3-21d6-498c-b649-bc77041c0cfc tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.474s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:39.586084 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:39.586766 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing instance network info cache due to event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:39.586957 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:39.587084 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:39.587199 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:39.690706 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:40.091846 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:40.472811 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:40.627363 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updated VIF entry in instance network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:20:40.627796 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:41.121170 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:41.129623 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-247a9436-c8e9-46d7-8a20-f39505d7ca6e req-cc6ce7e1-4526-4c64-b3ae-4181425eb3cd service nova] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:41.641787 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:41.643741 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing instance network info cache due to event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:41.643741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:41.643741 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:41.643741 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:41.862081 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:41.862081 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:41.862241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:41.862306 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:41.862415 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:41.864305 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Terminating instance
May 13 02:20:42.147122 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:42.367836 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:20:42.377427 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.392454 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.416505 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.419945 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.451794 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.462557 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:42.548950 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:42.550361 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:42.551106 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:42.551832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:42.552003 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] No waiting events found dispatching network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:42.552675 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-84393183-6199-44f8-9aa9-524560194b4f req-fb5982b7-6acf-4b46-8858-1f8e25de2a04 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:42.665908 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updated VIF entry in instance network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:20:42.666322 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:42.689586 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:42.715854 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99971473000005 future=<Future at 0x705c4868f1d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:42.716005 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999528143000134 future=<Future at 0x705c4868f1d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:42.716084 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999434970000038 future=<Future at 0x705c4868f1d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:42.717578 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Instance destroyed successfully.
May 13 02:20:42.718064 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 90e1017f-ad0b-497c-aa9c-1e9312587a5d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:43.011500 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_power_states {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:20:43.168336 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0a7065d5-4262-4a1e-90ca-b35979b4adb0 req-e95d5b83-0e9d-4bd3-a64c-09abac5a7f2d service nova] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:43.222780 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:19:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1721334351',display_name='tempest-TestVolumeBootPattern-server-1721334351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1721334351',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:20:02Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cywm870s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:20:02Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=90e1017f-ad0b-497c-aa9c-1e9312587a5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:20:43.223046 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "998043fe-d890-43af-9004-360b27f55c36", "address": "fa:16:3e:97:75:56", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap998043fe-d8", "ovs_interfaceid": "998043fe-d890-43af-9004-360b27f55c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:20:43.223613 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:20:43.223846 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:20:43.225196 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:43.225461 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap998043fe-d8, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:43.226470 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:43.228011 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:43.228646 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:43.228824 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=922e1407-a20d-4336-9423-ac1e6011446a) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:20:43.229374 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:43.230419 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:20:43.232123 np0000000663 nova-compute[98103]: INFO os_vif [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:75:56,bridge_name='br-int',has_traffic_filtering=True,id=998043fe-d890-43af-9004-360b27f55c36,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap998043fe-d8')
May 13 02:20:43.233910 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:20:43.234341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:43.234529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:43.234896 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:43.235317 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:20:43.235485 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4331b90-4e13-4b5b-b08f-070fe7028fb2 (non-flash)
May 13 02:20:43.261475 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]: tcp: [218] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4331b90-4e13-4b5b-b08f-070fe7028fb2 (non-flash)
May 13 02:20:43.261741 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:43.261863 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4331b90-4e13-4b5b-b08f-070fe7028fb2', '218')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:20:43.262282 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '209')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:20:43.263657 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '210')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:20:43.264717 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c242e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'): ({'sdb'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:20:43.264954 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:20:43.265245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 330000000bc7bdbad {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:20:43.320512 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:20:43.367505 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:20:43.413710 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:20:43.413941 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:20:43.415565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:20:43.427793 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:20:43.428089 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:20:43.439121 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.476602 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260]
May 13 02:20:43.476602 np0000000663 nova-compute[98103]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260] successful.
May 13 02:20:43.476602 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.494615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.505353 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.520066 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 90e1017f-ad0b-497c-aa9c-1e9312587a5d {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:20:43.520406 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:20:43.520576 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:20:43.523931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:43.523931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:43.524176 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Triggering sync for uuid e2be1263-ac67-49fb-a8b7-17c80b5c534b {{(pid=98103) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 13 02:20:43.524468 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:43.524698 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:43.524767 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:43.525188 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:43.525408 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 18.87 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:20:43.525535 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:43.543192 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260]
May 13 02:20:43.543192 np0000000663 nova-compute[98103]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260] successful.
May 13 02:20:43.543192 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.558587 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:43.558760 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:43.558886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (324ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:43.559037 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:20:43.559302 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Deleting instance files /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d_del
May 13 02:20:43.559880 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Deletion of /opt/stack/data/nova/instances/90e1017f-ad0b-497c-aa9c-1e9312587a5d_del complete
May 13 02:20:44.035701 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:44.036308 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:44.037477 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:44.065986 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Took 1.70 seconds to destroy the instance on the hypervisor.
May 13 02:20:44.066539 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:20:44.066684 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:20:44.066755 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:20:44.066933 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:44.162922 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:44.603765 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:44.604180 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] Acquiring lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:44.604366 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:44.604530 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:44.604692 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] No waiting events found dispatching network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:20:44.604864 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-unplugged-998043fe-d890-43af-9004-360b27f55c36 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:20:44.605012 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Received event network-vif-deleted-998043fe-d890-43af-9004-360b27f55c36 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:44.605205 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Neutron deleted interface 998043fe-d890-43af-9004-360b27f55c36; detaching it from the instance and deleting it from the info cache
May 13 02:20:44.605353 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:45.045473 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:45.108829 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-999e9ceb-6bb1-464f-b9b1-70bbd0625164 req-097d5848-4f44-414f-a726-46927b6e6924 service nova] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Detach interface failed, port_id=998043fe-d890-43af-9004-360b27f55c36, reason: Instance 90e1017f-ad0b-497c-aa9c-1e9312587a5d could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:20:45.547555 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Took 1.48 seconds to deallocate network for instance.
May 13 02:20:46.090972 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Took 0.54 seconds to detach 1 volumes for instance.
May 13 02:20:46.121361 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:46.596512 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:46.596717 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:46.809872 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:46.810239 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:47.312941 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:47.820009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.223s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:47.867106 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 90e1017f-ad0b-497c-aa9c-1e9312587a5d
May 13 02:20:48.230848 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:48.875891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-a5fa926f-4830-4e2f-a322-3467d549f67b tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.014s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:48.876776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.355s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:48.876983 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] During sync_power_state the instance has a pending task (deleting). Skip.
May 13 02:20:48.877118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "90e1017f-ad0b-497c-aa9c-1e9312587a5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:50.735448 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:50.735823 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:51.129833 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:51.238202 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:20:51.782336 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:51.782758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:51.785508 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:20:51.785647 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Claim successful on node np0000000663
May 13 02:20:52.994224 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:20:52.994621 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:20:53.232613 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:53.496446 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:20:54.004275 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.222s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:54.004812 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:20:54.511415 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:20:54.513077 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:20:54.513428 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:54.513763 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:54.597514 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:20:55.012391 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:20:55.116109 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Successfully created port: 2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:20:55.419986 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:55.420118 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:55.420298 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Rebooting instance
May 13 02:20:55.515579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:20:55.525256 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Successfully updated port: 2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:20:55.578415 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:20:55.578824 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing instance network info cache due to event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:20:55.578991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] Acquiring lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:55.579063 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] Acquired lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:55.579268 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing network info cache for port 2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:20:55.965776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:55.965891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:55.965999 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:20:56.019066 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Booting with volume 8009b6b3-8da6-4b8e-b848-77d2d2d8d643 at /dev/vda
May 13 02:20:56.028293 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:20:56.055927 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:56.065591 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:20:56.080835 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:56.083852 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:56.126621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:20:56.126875 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:20:56.131574 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:56.134552 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:20:56.136564 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe01:5067', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe50:22ae', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fef2:8cb9', 'fe80::9cba:3bff:fe2a:a965'] 
May 13 02:20:56.136799 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:20:56.136934 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:20:56.137230 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:56.137524 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating existing volume attachment record: 1454f125-212c-453c-a5ad-bb9978247850 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:20:56.149011 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:56.274027 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:56.468201 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:56.736518 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:56.776801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8f64af21-ab39-43dd-af87-0dba05e0ae21 req-a2a5c614-8d1f-4d7d-b4fa-bf5753c470af service nova] Releasing lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:56.777520 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:20:56.777593 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:20:56.796626 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:56.796831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:56.852086 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:57.300121 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:20:57.331164 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:20:57.354036 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:57.463184 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:20:57.594123 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:20:57.716003 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004038440001750132 future=<Future at 0x705c4868f1d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:57.716434 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:20:57.716792 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638842.715466, 90e1017f-ad0b-497c-aa9c-1e9312587a5d => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:20:57.717046 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] VM Stopped (Lifecycle Event)
May 13 02:20:57.857760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:58.095814 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:20:58.096101 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance network_info: |[{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:20:58.221723 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-ef147a73-8b4d-41a6-944c-79e255abd512 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 90e1017f-ad0b-497c-aa9c-1e9312587a5d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:20:58.223222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:20:58.223746 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:20:58.224126 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Creating image(s)
May 13 02:20:58.224423 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:20:58.225074 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Ensure instance console log exists: /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:20:58.225074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:58.225074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:58.225074 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:58.225610 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Start _get_guest_xml network_info=[{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3eb20366-64b5-4f14-91bd-74d4e11ecd4d', 'attached_at': '', 'detached_at': '', 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'serial': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643'}, 'attachment_id': '1454f125-212c-453c-a5ad-bb9978247850', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:20:58.228224 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:20:58.229186 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-345927682', uuid='3eb20366-64b5-4f14-91bd-74d4e11ecd4d'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638858.2289007) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:20:58.230412 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:20:58.230719 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:20:58.233296 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:20:58.233443 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:20:58.234332 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:20:58.234588 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:20:58.234741 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:20:58.234837 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:20:58.234951 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:20:58.235035 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:20:58.235766 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:58.235836 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:20:58.236056 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:20:58.236211 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:20:58.236313 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:20:58.236510 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:20:58.236615 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:20:58.245634 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:20:58.246057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:58.246242 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:58.246589 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:58.246709 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:20:58.261236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:58.261782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:20:58.262917 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:58.263269 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:58.263620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:20:58.263793 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:58.274584 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:58.274584 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:58.280420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:20:58.280420 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:58.286789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643] added
May 13 02:20:58.286789 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:58.286789 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:58.286789 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:58.286789 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:58.286789 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:58.286789 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:58.286982 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:58.287692 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:58.287825 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:58.291076 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643] added
May 13 02:20:58.291076 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:20:58.291076 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:58.291076 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:58.291076 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:20:58.291076 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:20:58.291076 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:58.291236 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:20:58.291404 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:20:58.291530 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:20:58.304411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:20:58.865138 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:20:59.288243 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:20:59.292164 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:59.305724 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:59.305724 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:20:59.308741 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:20:59.308741 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.319061 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.323765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.332532 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.332532 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.332532 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.332532 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.332532 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:59.332724 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.332724 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.332724 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.332724 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.332724 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:59.337360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.337360 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.337360 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.337360 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.337360 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:59.337535 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.337535 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.337535 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.337535 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.337535 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:59.372495 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260]
May 13 02:20:59.372495 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260] successful.
May 13 02:20:59.372495 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.377194 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260]
May 13 02:20:59.377194 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260] successful.
May 13 02:20:59.377194 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.384380 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.390364 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.399441 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.399670 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:59.399877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:59.400027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:59.401142 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:20:59.401371 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:20:59.401551 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Attaching volume c6186d62-161c-437b-8daf-a30eb331acae to /dev/vdb
May 13 02:20:59.403131 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('7', '-', '-', 0) found on session 219 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:59.403279 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.404459 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:20:59.405921 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('8', '-', '-', 0) found on session 220 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:20:59.405921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:20:59.418313 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:59.419405 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:59.425886 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 220 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:20:59.426057 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:20:59.443117 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:20:59.454774 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:20:59.478283 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:20:59.530365 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:20:59.530731 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:20:59.539618 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:20:59.541727 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe01:5067', 'fe80::2813:28ff:fee9:663e', 'fe80::fc16:3eff:fe50:22ae', 'fe80::c045:1bff:fe01:bef', 'fe80::fc16:3eff:fef2:8cb9', 'fe80::9cba:3bff:fe2a:a965'] 
May 13 02:20:59.541727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:20:59.541727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:20:59.541980 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:20:59.542200 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updating existing volume attachment record: 06decef6-d592-467b-8593-5fb877ff306a {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:21:00.093002 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:21:00.093374 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:00.093549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:00.264392 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:21:01.133108 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.238742 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.241049 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.261255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.261969 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.284027 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 330000000bc7bdbad for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:21:01.284436 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:01.284623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000bc7bdbad', 'path': '/dev/dm-0', 'multipath_id': '330000000bc7bdbad'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:01.284754 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bc7bdbad', 'path': '/dev/dm-0', 'multipath_id': '330000000bc7bdbad'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:21:01.285497 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.192s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:01.285725 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:21:01.292243 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:01.302299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:01.302818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:01.303246 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:01.303444 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:21:01.303873 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:01.306489 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:21:01.314765 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:21:01.314765 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:01.320365 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:21:01.320365 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae] added
May 13 02:21:01.329114 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:01.329114 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:21:01.329114 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:21:01.332755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae] added
May 13 02:21:01.332755 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:21:01.332755 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:01.332755 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:01.332755 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:01.332755 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:01.332755 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:01.332946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:21:01.333148 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.029(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:21:01.333295 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:21:01.374873 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:01.376235 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:01.376387 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:01.376513 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:01.376639 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:01.376750 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-cd547e65-e429-40fb-80ea-ddc6a767fcfe req-c5bfc712-27e2-4873-b98a-df362e5d10e7 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received unexpected event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with vm_state active and task_state reboot_started.
May 13 02:21:01.581646 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999621957000272 future=<Future at 0x705c6c629d60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:01.581946 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999291433000053 future=<Future at 0x705c6c629d60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:01.582066 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99914439000031 future=<Future at 0x705c6c629d60 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:01.795202 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345927682',display_name='tempest-TestVolumeBootPattern-server-345927682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-345927682',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-kx7ff037',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:56Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=3eb20366-64b5-4f14-91bd-74d4e11ecd4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:21:01.795392 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:21:01.796134 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:21:01.796921 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 3eb20366-64b5-4f14-91bd-74d4e11ecd4d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:01.882936 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance shutdown successfully.
May 13 02:21:02.281155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.302318 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] End _get_guest_xml xml=<domain type="qemu">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <uuid>3eb20366-64b5-4f14-91bd-74d4e11ecd4d</uuid>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <name>instance-0000004f</name>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-345927682</nova:name>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:20:58</nova:creationTime>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         <nova:port uuid="2315ee0a-1ee0-4610-ad96-6db2ca00013a">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <system>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="serial">3eb20366-64b5-4f14-91bd-74d4e11ecd4d</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="uuid">3eb20366-64b5-4f14-91bd-74d4e11ecd4d</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </system>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <os>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </os>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <features>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </features>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   <devices>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/disk.config"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </disk>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <alias name="ua-8009b6b3-8da6-4b8e-b848-77d2d2d8d643"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-0"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <serial>8009b6b3-8da6-4b8e-b848-77d2d2d8d643</serial>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </disk>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:5f:f3:ed"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <target dev="tap2315ee0a-1e"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </interface>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/console.log" append="off"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </serial>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <video>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </video>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </rng>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:   </devices>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]: </domain>
May 13 02:21:02.302318 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:21:02.306052 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Preparing to wait for external event network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:21:02.306052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:02.306052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:02.306052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:02.306052 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345927682',display_name='tempest-TestVolumeBootPattern-server-345927682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-345927682',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-kx7ff037',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:20:56Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=3eb20366-64b5-4f14-91bd-74d4e11ecd4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:21:02.306536 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.308253 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:21:02.310669 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:21:02.310915 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:21:02.311343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.311611 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:02.313170 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:21:02.313170 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.313412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c45c4f66-3f74-5ad8-a882-1cff3d4dccd5', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:02.314883 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.316006 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:02.318112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.318301 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2315ee0a-1e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:02.318612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2315ee0a-1e, col_values=(('qos', UUID('c1969ddc-dbb0-48c9-8a5b-f8e0cab27138')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:02.318780 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2315ee0a-1e, col_values=(('external_ids', {'iface-id': '2315ee0a-1ee0-4610-ad96-6db2ca00013a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:f3:ed', 'vm-uuid': '3eb20366-64b5-4f14-91bd-74d4e11ecd4d'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:02.320020 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.321337 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:02.325498 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.326638 np0000000663 nova-compute[98103]: INFO os_vif [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e')
May 13 02:21:02.327578 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:21:02.334541 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:21:02.344225 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:21:02.344225 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:21:02.353961 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:21:02.353961 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.363625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.372148 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.381457 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.381612 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.395620 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:02.398211 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:02.398582 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:02.434808 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.40.100,3260]
May 13 02:21:02.434808 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.40.100,3260] successful.
May 13 02:21:02.434808 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.436474 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.447435 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.457834 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.50.100,3260]
May 13 02:21:02.457834 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.50.100,3260] successful.
May 13 02:21:02.457834 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.475637 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:02.476188 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.476565 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:02.476835 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:02.477182 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:21:02.478169 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('13', '-', '-', 0) found on session 221 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:21:02.478295 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:21:02.498870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 221 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:21:02.498870 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:02.499968 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:02.499968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:02.500508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:21:02.501072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] HCTL ('14', '-', '-', 0) found on session 222 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:21:02.501770 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:21:02.521518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Searching for a device in session 222 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:21:02.521518 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:21:02.740837 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.748744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.749859 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.771818 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.777865 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:02.884564 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:02.884862 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:03.097598 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Removed pending STOPPED event for 5f2a891b-623d-4145-b997-285c23394f55 due to new event <LifecycleEvent: 1778638863.0971997, 5f2a891b-623d-4145-b997-285c23394f55 => Resumed> {{(pid=98103) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 13 02:21:03.097739 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638863.0971997, 5f2a891b-623d-4145-b997-285c23394f55 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:03.097889 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Resumed (Lifecycle Event)
May 13 02:21:03.101289 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance running successfully.
May 13 02:21:03.102865 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance soft rebooted successfully.
May 13 02:21:03.102865 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:03.306674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:21:03.449061 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:03.449222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:03.449364 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:03.449475 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:03.449585 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:03.449684 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received unexpected event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with vm_state active and task_state None.
May 13 02:21:03.449779 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:03.449880 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:03.450029 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:03.450172 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:03.450568 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:03.450701 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received unexpected event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with vm_state active and task_state None.
May 13 02:21:03.450821 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:03.450967 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:03.451134 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:03.451258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:03.451388 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:03.451507 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-6359ab42-140c-4dc6-80ab-b8d0cf9f0624 req-5bbd6cbe-101e-4bb1-8b80-84c588d78520 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received unexpected event network-vif-plugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with vm_state active and task_state None.
May 13 02:21:03.600468 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:03.603370 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:21:03.608195 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-98e93b71-a736-4ce3-8abf-7cbdf16ea789 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.188s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:03.858683 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:21:03.858881 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:21:03.859025 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:5f:f3:ed, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:21:03.859448 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Using config drive
May 13 02:21:03.878346 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:03.880529 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:04.105600 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638864.1053, 5f2a891b-623d-4145-b997-285c23394f55 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:04.105749 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Started (Lifecycle Event)
May 13 02:21:04.320873 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found WWN 3300000008926715f for multipath device dm-4 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:21:04.321322 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:04.321381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== connect_volume: return (4227ms) {'type': 'block', 'scsi_wwn': '3300000008926715f', 'path': '/dev/dm-4', 'multipath_id': '3300000008926715f'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:04.321484 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008926715f', 'path': '/dev/dm-4', 'multipath_id': '3300000008926715f'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:21:04.324230 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:04.364251 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:04.468576 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Creating config drive at /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/disk.config
May 13 02:21:04.471611 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9383yozz {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:04.525907 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9383yozz" returned: 0 in 0.054s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:04.608381 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:04.611579 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:21:04.827477 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Attempting to attach volume c6186d62-161c-437b-8daf-a30eb331acae with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:21:04.829295 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <alias name="ua-c6186d62-161c-437b-8daf-a30eb331acae"/>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <serial>c6186d62-161c-437b-8daf-a30eb331acae</serial>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]: </disk>
May 13 02:21:04.829295 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:21:04.884046 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:04.884496 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:04.936202 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:04.962683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:04.968186 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.121669 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-208ee168-eebf-4cd4-9d2c-a2a992875619 req-6718e5b6-a4a0-417e-a938-adf3f82b227a service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:05.123658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-208ee168-eebf-4cd4-9d2c-a2a992875619 req-6718e5b6-a4a0-417e-a938-adf3f82b227a service nova] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:05.123658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-208ee168-eebf-4cd4-9d2c-a2a992875619 req-6718e5b6-a4a0-417e-a938-adf3f82b227a service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:05.123658 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-208ee168-eebf-4cd4-9d2c-a2a992875619 req-6718e5b6-a4a0-417e-a938-adf3f82b227a service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:05.123658 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-208ee168-eebf-4cd4-9d2c-a2a992875619 req-6718e5b6-a4a0-417e-a938-adf3f82b227a service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Processing event network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:21:05.175471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.275849 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.280996 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.281768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.298787 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:05.831790 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638865.8312905, 3eb20366-64b5-4f14-91bd-74d4e11ecd4d => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:05.832323 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:21:05.832397 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] VM Started (Lifecycle Event)
May 13 02:21:05.835662 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:21:05.838690 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance spawned successfully.
May 13 02:21:05.838880 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:21:05.883977 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:05.884149 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:21:05.884387 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:06.144101 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:06.334715 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:06.337019 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:21:06.346387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.346387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.346387 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.346617 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.347943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.347943 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:21:06.586900 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:21:06.587425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:21:06.587425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:21:06.587425 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] No VIF found with MAC fa:16:3e:01:50:67, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:21:06.839362 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:21:06.839886 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638866.8394616, 3eb20366-64b5-4f14-91bd-74d4e11ecd4d => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:06.839886 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] VM Paused (Lifecycle Event)
May 13 02:21:06.853467 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Took 8.63 seconds to spawn the instance on the hypervisor.
May 13 02:21:06.853578 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:06.884397 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:06.885176 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:07.174837 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:07.175049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:07.175239 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:07.175359 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:07.175501 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] No waiting events found dispatching network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:07.175684 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-b7f72af1-ce6a-4984-9653-aabe8cb7af05 req-5960863c-2aa7-46ac-94cb-1293f0b04425 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received unexpected event network-vif-plugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a for instance with vm_state active and task_state None.
May 13 02:21:07.334244 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:07.342245 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:07.344384 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638867.344193, 3eb20366-64b5-4f14-91bd-74d4e11ecd4d => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:07.344498 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] VM Resumed (Lifecycle Event)
May 13 02:21:07.362506 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Took 15.62 seconds to build instance.
May 13 02:21:07.846747 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:07.849058 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:21:07.863776 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-bc50bdba-d4fb-46ac-a926-0b5730ef3068 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.128s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:07.883876 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:07.884442 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:21:08.138430 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-de59d539-7d73-4ec1-ada9-bece296397fa tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.737s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:08.390143 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:08.390289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:08.390452 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:08.390593 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:21:08.847019 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:08.847345 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing instance network info cache due to event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:21:08.847345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] Acquiring lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:21:08.847345 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] Acquired lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:21:08.847483 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing network info cache for port 2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:21:09.349707 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:09.383342 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:09.383490 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:09.417112 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:09.515991 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:09.516479 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:09.605888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:09.606347 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:21:09.611635 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:21:09.613555 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-6 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:21:09.615509 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:09.654909 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:09.704647 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:09.705081 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:09.795651 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updated VIF entry in instance network info cache for port 2315ee0a-1ee0-4610-ad96-6db2ca00013a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:21:09.796073 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:09.813555 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:09.814018 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:21:09.818613 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:21:09.819578 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:09.866640 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:21:09.867017 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=12931MB free_disk=72.58332824707031GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:21:09.867187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:09.867468 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:09.886046 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Detaching volume c6186d62-161c-437b-8daf-a30eb331acae
May 13 02:21:09.921791 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Attempting to driver detach volume c6186d62-161c-437b-8daf-a30eb331acae from mountpoint /dev/vdb
May 13 02:21:09.927840 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-c6186d62-161c-437b-8daf-a30eb331acae {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:21:09.929217 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Found disk vdb by alias ua-c6186d62-161c-437b-8daf-a30eb331acae {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:21:09.929621 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Attempting to detach device vdb from instance 0456364e-fbd2-4f95-a603-ae758aec59f8 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:21:09.929851 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <alias name="ua-c6186d62-161c-437b-8daf-a30eb331acae"/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <serial>c6186d62-161c-437b-8daf-a30eb331acae</serial>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]: </disk>
May 13 02:21:09.929851 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:21:09.934447 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance 0456364e-fbd2-4f95-a603-ae758aec59f8 from the persistent domain config.
May 13 02:21:09.934684 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] (1/8): Attempting to detach device vdb with device alias ua-c6186d62-161c-437b-8daf-a30eb331acae from instance 0456364e-fbd2-4f95-a603-ae758aec59f8 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:21:09.934896 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <alias name="ua-c6186d62-161c-437b-8daf-a30eb331acae"/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-4"/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <serial>c6186d62-161c-437b-8daf-a30eb331acae</serial>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <shareable/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]: </disk>
May 13 02:21:09.934896 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:21:10.298716 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e3c0e221-928c-4fe9-83b6-439026e69374 req-69cf6f13-e886-4d30-ae5a-505c89aacb31 service nova] Releasing lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:21:10.405741 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638870.4053931, 0456364e-fbd2-4f95-a603-ae758aec59f8 => ua-c6186d62-161c-437b-8daf-a30eb331acae> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:21:10.407301 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c6186d62-161c-437b-8daf-a30eb331acae for instance 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:21:10.409783 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully detached device vdb from instance 0456364e-fbd2-4f95-a603-ae758aec59f8 from the live domain config.
May 13 02:21:10.436520 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:21:10.436879 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:10.437055 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:10.437420 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:10.437688 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c6186d62-161c-437b-8daf-a30eb331acae', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:21:10.437818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:10.464192 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae (non-flash)
May 13 02:21:10.464429 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:10.464615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', '222')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:21:10.464615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', '221')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:10.465478 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae', '222')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:10.466205 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c48716840>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'): ({'sdi'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:21:10.466390 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Removing multipathed devices sdh, sdi {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:21:10.466625 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Flush multipath device 3300000008926715f {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:21:10.498275 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:10.536601 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:10.578510 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:21:10.578701 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:21:10.579947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:21:10.591927 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:21:10.592268 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:21:10.603529 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.632068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.40.100,3260]
May 13 02:21:10.632068 np0000000663 nova-compute[98103]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.40.100,3260] successful.
May 13 02:21:10.632068 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.653407 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.664345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.700352 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.50.100,3260]
May 13 02:21:10.700352 np0000000663 nova-compute[98103]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-c6186d62-161c-437b-8daf-a30eb331acae, portal: 192.168.50.100,3260] successful.
May 13 02:21:10.700352 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.716161 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:10.716433 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:10.716588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] <== disconnect_volume: return (279ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:10.716734 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:21:10.933121 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 0456364e-fbd2-4f95-a603-ae758aec59f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:21:10.933689 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5f2a891b-623d-4145-b997-285c23394f55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:21:10.933829 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance e2be1263-ac67-49fb-a8b7-17c80b5c534b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:21:10.933982 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 3eb20366-64b5-4f14-91bd-74d4e11ecd4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:21:10.934212 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:21:10.934372 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:21:09 up 45 min,  2 users,  load average: 5.84, 6.12, 5.29\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_7a3847aeaf9841b199e63d3c1c099c9f': '1', 'io_workload': '0', 'num_proj_ad986512b43843d28a756102ac971343': '1', 'num_proj_57dfe4c819c84128b0149ebe05ecf5be': '1', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:21:11.143867 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:21:11.144108 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:21:11.146217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:11.259322 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'flavor' on Instance uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:11.649721 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:21:12.077816 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:12.078185 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:12.079563 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:12.079801 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:12.079950 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:12.082316 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Terminating instance
May 13 02:21:12.158081 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:21:12.158187 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.291s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:12.158525 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:21:12.265331 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-503c3bfd-bdb3-4815-a07a-f8d4e6328b5d tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.882s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:12.336219 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.585717 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:21:12.607180 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.609850 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.628362 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.631409 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.653301 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:12.752435 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:12.752577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:12.752727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:12.752831 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:12.752963 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] No waiting events found dispatching network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:12.753118 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4ed084e6-16d0-4b50-bb11-e4d0b83f9563 req-aa5fcf2c-98da-4449-853b-fb87b2fd6ead service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:12.925723 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99969027499992 future=<Future at 0x705c4864b860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:12.927826 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Instance destroyed successfully.
May 13 02:21:12.928213 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lazy-loading 'resources' on Instance uuid e2be1263-ac67-49fb-a8b7-17c80b5c534b {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:13.430553 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-156343259',display_name='tempest-TestEncryptedCinderVolumes-server-156343259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testencryptedcindervolumes-server-156343259',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDCfaaDNhutV96nb9CdF1udBhuJh5uDkCF74KM9wfu78kA67PU/fjz58FR8lmkEr8m7iAV6mV0VI54MyYKyD1y6EH5zkDgY4PeqZUjUbBsvndGIFiMWRYTs3ZD1c4ulAg==',key_name='tempest-TestEncryptedCinderVolumes-7197804',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:20:32Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57dfe4c819c84128b0149ebe05ecf5be',ramdisk_id='',reservation_id='r-1488grj2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-368552408',owner_user_name='tempest-TestEncryptedCinderVolumes-368552408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:20:33Z,user_data=None,user_id='7c20465c49104552b6af116f9e0c14d5',uuid=e2be1263-ac67-49fb-a8b7-17c80b5c534b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:21:13.431325 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converting VIF {"id": "4a11b2f3-af19-4c7b-8158-e0285420e241", "address": "fa:16:3e:f2:8c:b9", "network": {"id": "20b7f108-c4db-469b-96a4-c77b6d7f91ce", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1201072349-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57dfe4c819c84128b0149ebe05ecf5be", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a11b2f3-af", "ovs_interfaceid": "4a11b2f3-af19-4c7b-8158-e0285420e241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:21:13.431325 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:21:13.431521 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:21:13.432933 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:13.433213 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a11b2f3-af, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:13.436783 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:13.437477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:13.437651 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7d56a3d-4ffc-4dd6-845d-6d388e6705e8) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:13.439793 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:13.441366 np0000000663 nova-compute[98103]: INFO os_vif [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:8c:b9,bridge_name='br-int',has_traffic_filtering=True,id=4a11b2f3-af19-4c7b-8158-e0285420e241,network=Network(20b7f108-c4db-469b-96a4-c77b6d7f91ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a11b2f3-af')
May 13 02:21:13.444805 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:21:13.445140 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:13.445280 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:13.445553 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:13.445818 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '10d55471-f748-4a3c-bf91-e75c04bacda8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:21:13.445988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:13.472224 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsi session list stdout=tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8 (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:13.472404 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:13.472541 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '214'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:21:13.472597 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '215')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:13.473381 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8', '214')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:13.474014 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c240180>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:21:13.474193 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Removing multipathed devices sde, sdf {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:21:13.474387 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Flush multipath device 33000000008e9e043 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:21:13.513296 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:13.559807 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:13.607340 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:21:13.607567 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:21:13.608934 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:21:13.622921 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:21:13.623240 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:21:13.636822 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.668243 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.40.100,3260]
May 13 02:21:13.668243 np0000000663 nova-compute[98103]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.40.100,3260] successful.
May 13 02:21:13.668243 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.687621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.702714 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.736166 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.50.100,3260]
May 13 02:21:13.736166 np0000000663 nova-compute[98103]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-10d55471-f748-4a3c-bf91-e75c04bacda8, portal: 192.168.50.100,3260] successful.
May 13 02:21:13.736166 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.755590 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:13.755760 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:13.756216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:13.756216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:13.756216 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:13.758221 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Terminating instance
May 13 02:21:13.761782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:13.762698 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:13.762847 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] <== disconnect_volume: return (317ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:13.762990 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:21:13.763495 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Deleting instance files /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b_del
May 13 02:21:13.763997 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Deletion of /opt/stack/data/nova/instances/e2be1263-ac67-49fb-a8b7-17c80b5c534b_del complete
May 13 02:21:14.263878 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:21:14.274122 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Took 1.69 seconds to destroy the instance on the hypervisor.
May 13 02:21:14.278112 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:21:14.278112 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:21:14.278112 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:21:14.278112 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:14.298255 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.320068 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.323491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.346709 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.370861 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:14.571945 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.578683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:14.605613 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999737733000075 future=<Future at 0x705c48738770 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:14.608412 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Instance destroyed successfully.
May 13 02:21:14.608779 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lazy-loading 'resources' on Instance uuid 0456364e-fbd2-4f95-a603-ae758aec59f8 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:14.820512 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:14.820735 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Acquiring lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:14.820953 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:14.821156 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:14.821675 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] No waiting events found dispatching network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:14.821887 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-unplugged-4a11b2f3-af19-4c7b-8158-e0285420e241 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:14.821990 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:14.822142 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:14.822305 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:14.822412 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:14.822530 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] No waiting events found dispatching network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:14.822961 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:14.822961 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:14.822961 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Acquiring lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:14.823052 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:14.823116 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:14.823206 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] No waiting events found dispatching network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:14.823317 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f37afa34-fa57-41e1-931f-9fcd2ffcd016 req-7136a9b9-6afd-41e2-917f-ec1f2d35af81 service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-unplugged-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:14.837270 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-525df701-1c12-4ef8-b9d3-eacc8d792f76 req-ab84d1ee-54e0-479c-a5a6-3972fe18b5e0 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Received event network-vif-deleted-4a11b2f3-af19-4c7b-8158-e0285420e241 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:14.837684 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-525df701-1c12-4ef8-b9d3-eacc8d792f76 req-ab84d1ee-54e0-479c-a5a6-3972fe18b5e0 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Neutron deleted interface 4a11b2f3-af19-4c7b-8158-e0285420e241; detaching it from the instance and deleting it from the info cache
May 13 02:21:14.838237 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-525df701-1c12-4ef8-b9d3-eacc8d792f76 req-ab84d1ee-54e0-479c-a5a6-3972fe18b5e0 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:15.112182 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:20:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-709302027',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-volumemultiattachtests-server-709302027',id=76,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuZfZGNukLk2T85qz2GrrQLra93aTvnOayjz0ZQeUbuZsMMSo6iXhlBi5ftysRr6CG6DMwJP3YPVTEDuN1bjIE7/ENolF2NJ0jUFbXbj9qBCoCRmafxJ013ByCYv3uyuQ==',key_name='tempest-keypair-1339523636',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:20:17Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a3847aeaf9841b199e63d3c1c099c9f',ramdisk_id='',reservation_id='r-e7xnvwxi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-932012962',owner_user_name='tempest-VolumeMultiattachTests-932012962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4acc4ee8597744baa14224320669fc51',uuid=0456364e-fbd2-4f95-a603-ae758aec59f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:21:15.112467 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converting VIF {"id": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "address": "fa:16:3e:01:50:67", "network": {"id": "96cd5a74-ba2b-435d-9c9d-097af8f856c2", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-1024970574-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "7a3847aeaf9841b199e63d3c1c099c9f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b2bb339-ef", "ovs_interfaceid": "1b2bb339-ef59-437b-9fd4-e2ac09bc8591", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:21:15.113109 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:21:15.113294 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:21:15.114007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:15.114200 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b2bb339-ef, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:15.116415 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:15.116904 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:15.117473 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:15.117579 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a7eee65-938b-4932-a9bf-8321823b607f) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:15.119225 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:15.120548 np0000000663 nova-compute[98103]: INFO os_vif [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:50:67,bridge_name='br-int',has_traffic_filtering=True,id=1b2bb339-ef59-437b-9fd4-e2ac09bc8591,network=Network(96cd5a74-ba2b-435d-9c9d-097af8f856c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b2bb339-ef')
May 13 02:21:15.120802 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Deleting instance files /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8_del
May 13 02:21:15.121446 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Deletion of /opt/stack/data/nova/instances/0456364e-fbd2-4f95-a603-ae758aec59f8_del complete
May 13 02:21:15.297447 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:15.342293 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-525df701-1c12-4ef8-b9d3-eacc8d792f76 req-ab84d1ee-54e0-479c-a5a6-3972fe18b5e0 service nova] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Detach interface failed, port_id=4a11b2f3-af19-4c7b-8158-e0285420e241, reason: Instance e2be1263-ac67-49fb-a8b7-17c80b5c534b could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:21:15.627366 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Took 1.36 seconds to destroy the instance on the hypervisor.
May 13 02:21:15.627874 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:21:15.627983 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:21:15.628073 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:21:15.628315 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:15.746191 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:15.799938 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Took 1.52 seconds to deallocate network for instance.
May 13 02:21:16.146163 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:16.362386 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Took 0.56 seconds to detach 1 volumes for instance.
May 13 02:21:16.581701 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0003488809998088982 future=<Future at 0x705c6c629d60 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:16.581934 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:16.581934 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.343514556999708 future=<Future at 0x705c4864b860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:16.581934 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=11.343413169000087 future=<Future at 0x705c4864b860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:16.632433 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:16.866758 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:16.866971 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:16.891684 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-641504de-406c-42a7-bec1-1ed0bb2a1756 req-da4e83f6-36cc-439b-9b6d-8172f0c50d9f service nova] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Received event network-vif-deleted-1b2bb339-ef59-437b-9fd4-e2ac09bc8591 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:17.074176 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:21:17.074379 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:21:17.134547 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Took 1.51 seconds to deallocate network for instance.
May 13 02:21:17.576713 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:21:17.643901 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:18.082910 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.216s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:18.084286 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.440s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:18.135326 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Deleted allocations for instance e2be1263-ac67-49fb-a8b7-17c80b5c534b
May 13 02:21:18.266365 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:21:18.266578 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:21:18.769383 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:21:19.145001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e5f25e64-bc1c-4af9-a5f6-f0efbc82f2f9 tempest-TestEncryptedCinderVolumes-368552408 tempest-TestEncryptedCinderVolumes-368552408-project-member] Lock "e2be1263-ac67-49fb-a8b7-17c80b5c534b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.067s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:19.275958 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.192s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:19.322849 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Deleted allocations for instance 0456364e-fbd2-4f95-a603-ae758aec59f8
May 13 02:21:20.123988 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:20.334791 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-08e0aadb-8723-4265-96a8-fea2f1fd7e38 tempest-VolumeMultiattachTests-932012962 tempest-VolumeMultiattachTests-932012962-project-member] Lock "0456364e-fbd2-4f95-a603-ae758aec59f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.579s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:21.147393 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:22.181715 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:23.389320 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:23.717947 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:24.965385 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:25.125161 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:26.148708 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:27.925821 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0003046580000045651 future=<Future at 0x705c4864b860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:27.926253 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:27.926253 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.6792788160000782 future=<Future at 0x705c48738770 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:27.926253 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=1.6791952120001952 future=<Future at 0x705c48738770 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:27.928191 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638872.925315, e2be1263-ac67-49fb-a8b7-17c80b5c534b => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:27.928191 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] VM Stopped (Lifecycle Event)
May 13 02:21:28.429634 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-8a58b7ae-be24-45ce-a9f7-95919aa94875 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: e2be1263-ac67-49fb-a8b7-17c80b5c534b] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:29.605730 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0003590470000744972 future=<Future at 0x705c48738770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:29.606239 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Emitting event <LifecycleEvent: 1778638874.605252, 0456364e-fbd2-4f95-a603-ae758aec59f8 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:21:29.606239 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:29.606340 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] VM Stopped (Lifecycle Event)
May 13 02:21:30.108500 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-583a78a5-0939-46f4-9186-e7d53becec4f tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 0456364e-fbd2-4f95-a603-ae758aec59f8] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:21:30.126151 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:31.150541 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:35.127434 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:36.151319 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:40.128004 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:40.497234 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:40.694251 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:40.694413 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing instance network info cache due to event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:21:40.694601 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:21:40.694727 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:21:40.694913 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:21:41.142908 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:41.143558 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing instance network info cache due to event network-changed-fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:21:41.143786 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] Acquiring lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:21:41.152176 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:41.199324 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:41.530876 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:41.655720 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updated VIF entry in instance network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:21:41.655987 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:41.690051 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:41.690247 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:42.158624 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-71dd7618-634f-4462-9886-5482732a041a req-2ca9f85b-913d-4ade-9b22-d9ac6689a76e service nova] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:21:42.159215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] Acquired lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:21:42.159441 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Refreshing network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:21:42.192551 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Detaching volume 9a329b21-04fa-4b76-8523-1d5d51104e5b
May 13 02:21:42.236549 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Attempting to driver detach volume 9a329b21-04fa-4b76-8523-1d5d51104e5b from mountpoint /dev/vdb
May 13 02:21:42.245069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found disk vdb by alias ua-9a329b21-04fa-4b76-8523-1d5d51104e5b {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:21:42.245069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Found disk vdb by alias ua-9a329b21-04fa-4b76-8523-1d5d51104e5b {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:21:42.245069 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Attempting to detach device vdb from instance 5f2a891b-623d-4145-b997-285c23394f55 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:21:42.245244 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <alias name="ua-9a329b21-04fa-4b76-8523-1d5d51104e5b"/>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <serial>9a329b21-04fa-4b76-8523-1d5d51104e5b</serial>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]: </disk>
May 13 02:21:42.245244 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:21:42.254496 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully detached device vdb from instance 5f2a891b-623d-4145-b997-285c23394f55 from the persistent domain config.
May 13 02:21:42.254796 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] (1/8): Attempting to detach device vdb with device alias ua-9a329b21-04fa-4b76-8523-1d5d51104e5b from instance 5f2a891b-623d-4145-b997-285c23394f55 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:21:42.254796 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <alias name="ua-9a329b21-04fa-4b76-8523-1d5d51104e5b"/>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-3"/>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <serial>9a329b21-04fa-4b76-8523-1d5d51104e5b</serial>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]: </disk>
May 13 02:21:42.254796 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:21:42.662113 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:42.795021 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638902.7947218, 5f2a891b-623d-4145-b997-285c23394f55 => ua-9a329b21-04fa-4b76-8523-1d5d51104e5b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:21:42.798082 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9a329b21-04fa-4b76-8523-1d5d51104e5b for instance 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:21:42.800717 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully detached device vdb from instance 5f2a891b-623d-4145-b997-285c23394f55 from the live domain config.
May 13 02:21:42.801969 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:21:42.802256 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:42.802378 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:42.802674 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:42.802981 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9a329b21-04fa-4b76-8523-1d5d51104e5b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:21:42.803211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:21:42.828216 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:42.828216 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:42.828216 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:42.828216 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:42.828216 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:42.828434 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsi session list stdout=tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:42.828434 np0000000663 nova-compute[98103]: tcp: [217] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b (non-flash)
May 13 02:21:42.828434 np0000000663 nova-compute[98103]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:42.828434 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:42.828434 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:42.828782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '216'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '217'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:21:42.828782 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '216')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:42.829348 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b', '217')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:21:42.830064 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c487256c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'): ({'sdg'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:21:42.830290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Removing multipathed devices sdg, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:21:42.830531 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Flush multipath device 330000000072c6bd9 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:21:42.870347 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:42.916486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:21:42.945220 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:42.955615 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if SCSI volumes sdg, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:21:42.955845 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] SCSI volumes sdg, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:21:42.956690 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Checking to see if device paths {'sdg', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:21:42.968593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Device paths {'sdg', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:21:42.968832 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:21:42.980806 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.013163 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.40.100,3260]
May 13 02:21:43.013163 np0000000663 nova-compute[98103]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.40.100,3260] successful.
May 13 02:21:43.013163 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.025307 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.036643 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.062389 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updated VIF entry in instance network info cache for port fdb3d263-13d4-4da8-b476-a57c8f8d5685. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:21:43.062649 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [{"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:43.064147 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.50.100,3260]
May 13 02:21:43.064147 np0000000663 nova-compute[98103]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-9a329b21-04fa-4b76-8523-1d5d51104e5b, portal: 192.168.50.100,3260] successful.
May 13 02:21:43.064147 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.079114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:43.079314 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:43.079419 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] <== disconnect_volume: return (276ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:43.079522 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:21:43.564979 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5df429b1-83f0-41a7-ab26-0b505178c6e1 req-f0d6dc6e-9fd5-4bca-977a-e8e1456b8822 service nova] Releasing lock "refresh_cache-5f2a891b-623d-4145-b997-285c23394f55" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:21:43.620878 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'flavor' on Instance uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:44.625847 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-201b0e03-f745-4be9-8a3f-114fe9f07518 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.936s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:45.129615 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:45.998931 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:45.999482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:45.999482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:45.999482 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:45.999621 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:46.001455 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Terminating instance
May 13 02:21:46.153565 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.505074 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:21:46.523684 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.525408 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.541027 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.546545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.566198 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.571227 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:46.657587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:46.658411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:46.658411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:46.658411 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:46.658600 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:46.658765 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-8d874ca6-1a8a-49ab-a24d-09900e61c6fe req-fe1da469-e800-4708-93b6-e0c6a000b45d service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:46.817273 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999684935000005 future=<Future at 0x705c6c1b25a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:46.817572 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999190996999914 future=<Future at 0x705c6c1b25a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:46.817691 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999060023999846 future=<Future at 0x705c6c1b25a0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:21:46.821846 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Instance destroyed successfully.
May 13 02:21:46.822300 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lazy-loading 'resources' on Instance uuid 5f2a891b-623d-4145-b997-285c23394f55 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:21:47.324486 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-219971270',display_name='tempest-TestMinimumBasicScenario-server-219971270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testminimumbasicscenario-server-219971270',id=77,image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAw4h6HP7oliTV3o7zQ3lGGkNUw4Sa7ivbunF/2RD8+DYwf7et3r3EzUjn6BRXJgwxFcPGuOPzfgwW0xtUUM3Ii0Vk+MVdjBzRcaNtzFXlj+wN8JNo1WIc9jEtL4NLpW3A==',key_name='tempest-TestMinimumBasicScenario-1328816159',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:20:25Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad986512b43843d28a756102ac971343',ramdisk_id='',reservation_id='r-2kvnp4ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='773c7e22-9fa4-49e7-ba57-fc0315ab306c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1453218982',owner_user_name='tempest-TestMinimumBasicScenario-1453218982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:21:03Z,user_data=None,user_id='5b8270e949dc4210bf691de82ed07e0d',uuid=5f2a891b-623d-4145-b997-285c23394f55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:21:47.325166 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converting VIF {"id": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "address": "fa:16:3e:50:22:ae", "network": {"id": "8429b5c6-7385-4431-93c3-063d0c9bc368", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1163284927-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ad986512b43843d28a756102ac971343", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb3d263-13", "ovs_interfaceid": "fdb3d263-13d4-4da8-b476-a57c8f8d5685", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:21:47.325166 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:21:47.325351 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:21:47.326578 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.326729 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdb3d263-13, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:47.336263 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.336964 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:47.337193 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.337683 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.337791 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9085e432-ad9a-4050-8df9-4f13a0457e79) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:21:47.338148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.338539 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:21:47.338681 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:47.340525 np0000000663 nova-compute[98103]: INFO os_vif [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:22:ae,bridge_name='br-int',has_traffic_filtering=True,id=fdb3d263-13d4-4da8-b476-a57c8f8d5685,network=Network(8429b5c6-7385-4431-93c3-063d0c9bc368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb3d263-13')
May 13 02:21:47.340739 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Deleting instance files /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55_del
May 13 02:21:47.341377 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Deletion of /opt/stack/data/nova/instances/5f2a891b-623d-4145-b997-285c23394f55_del complete
May 13 02:21:47.847648 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Took 1.34 seconds to destroy the instance on the hypervisor.
May 13 02:21:47.848159 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:21:47.848440 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:21:47.848544 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:21:47.848777 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:47.914368 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:48.138165 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb8f1fa6-6837-410b-a860-d00da60914f5 req-a30f5635-4393-497d-b665-74457e9bffac service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-deleted-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:48.138502 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-cb8f1fa6-6837-410b-a860-d00da60914f5 req-a30f5635-4393-497d-b665-74457e9bffac service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Neutron deleted interface fdb3d263-13d4-4da8-b476-a57c8f8d5685; detaching it from the instance and deleting it from the info cache
May 13 02:21:48.138693 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-cb8f1fa6-6837-410b-a860-d00da60914f5 req-a30f5635-4393-497d-b665-74457e9bffac service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:48.594184 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:48.641924 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-cb8f1fa6-6837-410b-a860-d00da60914f5 req-a30f5635-4393-497d-b665-74457e9bffac service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Detach interface failed, port_id=fdb3d263-13d4-4da8-b476-a57c8f8d5685, reason: Instance 5f2a891b-623d-4145-b997-285c23394f55 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:21:48.711911 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:48.712127 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] Acquiring lock "5f2a891b-623d-4145-b997-285c23394f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:48.712316 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:48.712498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] Lock "5f2a891b-623d-4145-b997-285c23394f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:48.712587 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] No waiting events found dispatching network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:21:48.712716 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e9a23d80-724f-44e4-be9c-f20afc470771 req-971efd23-4fd3-4f34-9dd0-11c1e5180315 service nova] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Received event network-vif-unplugged-fdb3d263-13d4-4da8-b476-a57c8f8d5685 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:21:48.853723 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:48.853921 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:49.095901 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Took 1.25 seconds to deallocate network for instance.
May 13 02:21:49.355487 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:21:49.600625 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:49.601065 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:49.755380 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:21:49.755565 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:21:49.903554 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:50.257694 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:21:50.763149 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.162s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:50.764998 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.860s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:50.769023 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:21:50.769219 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Claim successful on node np0000000663
May 13 02:21:50.818438 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Deleted allocations for instance 5f2a891b-623d-4145-b997-285c23394f55
May 13 02:21:51.826278 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-7a2291b8-e496-4321-a2a3-5153164fcdc7 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Lock "5f2a891b-623d-4145-b997-285c23394f55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.827s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:51.893470 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:21:51.893639 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:21:52.339120 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:52.395897 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:21:52.904117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.139s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:52.904117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:21:53.408622 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:21:53.408804 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:21:53.409069 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:53.409630 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:53.475293 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7980d292f588498685ffe894352e1443', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75f3a6b45e2d4a68b7fa986edb3c82a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:21:53.909970 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:21:53.920059 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:53.940062 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Successfully created port: fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:21:54.357033 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Successfully updated port: fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:21:54.400989 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:21:54.401342 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing instance network info cache due to event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:21:54.401511 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] Acquiring lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:21:54.401597 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] Acquired lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:21:54.401697 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing network info cache for port fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:21:54.412837 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:21:54.859237 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:21:54.903267 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:54.916958 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Booting with volume 784a0258-3180-4648-bbab-be999291c63b at /dev/vda
May 13 02:21:54.958882 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:54.963819 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:21:54.971077 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:21:54.992712 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:21:55.046839 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:21:55.047323 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:21:55.055840 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:21:55.056955 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fe5f:f3ed', 'fe80::7ce0:14ff:fe99:c075'] 
May 13 02:21:55.057103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:21:55.057254 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:21:55.057564 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:21:55.057890 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating existing volume attachment record: 6afc361e-37c7-44b9-af6d-f55c1b1249ca {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:21:55.110794 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:55.417884 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:55.613313 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-2bff288a-863d-4d45-9ef6-f8f1e2579628 req-92095f10-b15c-403c-ac6e-9273a2f40b3c service nova] Releasing lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:21:55.613495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquired lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:21:55.613645 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:21:56.177677 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:21:56.313346 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:21:56.434545 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:21:56.936374 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Releasing lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:21:56.936656 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance network_info: |[{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:21:57.145687 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:21:57.146762 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:21:57.146979 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Creating image(s)
May 13 02:21:57.147258 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Did not create local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 13 02:21:57.147378 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Ensure instance console log exists: /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:21:57.147593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:21:57.147764 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:21:57.147889 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:21:57.148308 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Start _get_guest_xml network_info=[{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5941cec5-ef65-4821-a5bb-eaea7ea24e5e', 'attached_at': '', 'detached_at': '', 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'serial': '784a0258-3180-4648-bbab-be999291c63b'}, 'attachment_id': '6afc361e-37c7-44b9-af6d-f55c1b1249ca', 'mount_device': '/dev/vda', 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:21:57.154546 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:21:57.155656 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1791632444', uuid='5941cec5-ef65-4821-a5bb-eaea7ea24e5e'), owner=OwnerMeta(userid='7980d292f588498685ffe894352e1443', username='tempest-TestVolumeBootPattern-1996194033-project-member', projectid='75f3a6b45e2d4a68b7fa986edb3c82a5', projectname='tempest-TestVolumeBootPattern-1996194033'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638917.155345) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:21:57.159216 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:21:57.159569 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:21:57.161052 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:21:57.161393 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:21:57.162342 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:21:57.162553 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:21:57.162686 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:21:57.162789 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:21:57.162899 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:21:57.162971 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:21:57.163059 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:21:57.163238 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:21:57.163333 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:21:57.163457 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:21:57.163553 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:21:57.163613 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:21:57.173541 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:21:57.173927 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:21:57.174135 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:57.174486 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:57.174745 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:21:57.188651 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:57.189043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:57.189224 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:21:57.190209 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:21:57.190888 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:21:57.191146 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:21:57.202710 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:21:57.202710 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:57.208181 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:21:57.208181 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:57.215623 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b] added
May 13 02:21:57.215623 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:21:57.215623 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:57.215623 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:57.215623 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:57.215623 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:57.215623 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:57.215872 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:21:57.215900 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:21:57.216406 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:21:57.221238 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b] added
May 13 02:21:57.221238 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:21:57.221238 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:57.221238 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:57.221238 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:21:57.221238 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:21:57.221238 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:57.221446 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:21:57.221593 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:21:57.221736 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:21:57.340144 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:58.216487 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:21:58.222153 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:21:58.228923 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:21:58.228923 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:21:58.235184 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:21:58.235184 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.241785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.247711 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.256067 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.256067 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.256067 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:58.256241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.256241 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.256241 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:58.264426 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.264426 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.264426 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:58.264554 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.264554 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.264554 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:58.289151 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.40.100,3260]
May 13 02:21:58.289151 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.40.100,3260] successful.
May 13 02:21:58.289151 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.300059 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.307429 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.50.100,3260]
May 13 02:21:58.307429 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.50.100,3260] successful.
May 13 02:21:58.307429 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.314415 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.314415 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.314415 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.314415 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.314415 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:58.314565 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.314565 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.314565 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.314565 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.314565 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:58.314755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:58.314895 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:21:58.315595 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('9', '-', '-', 0) found on session 223 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:21:58.315704 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:21:58.317016 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:21:58.329430 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:21:58.334786 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.334786 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.334786 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.334786 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.334786 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:21:58.334950 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.334950 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:21:58.334950 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.334950 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:21:58.334950 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:21:58.335476 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:21:58.335621 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:21:58.336475 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] HCTL ('10', '-', '-', 0) found on session 224 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:21:58.336622 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:21:58.349460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 224 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:21:58.349460 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:21:58.715714 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:21:59.330727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:21:59.331139 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:22:00.074744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:00.210746 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Found WWN 330000000f58ad14a for multipath device dm-3 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:22:00.211388 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:22:00.211449 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000f58ad14a', 'path': '/dev/dm-3', 'multipath_id': '330000000f58ad14a'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:22:00.211572 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f58ad14a', 'path': '/dev/dm-3', 'multipath_id': '330000000f58ad14a'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:22:00.717473 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1791632444',display_name='tempest-TestVolumeBootPattern-server-1791632444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1791632444',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cus9yfsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:21:54Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=5941cec5-ef65-4821-a5bb-eaea7ea24e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:22:00.718001 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:00.718431 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:00.719234 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'pci_devices' on Instance uuid 5941cec5-ef65-4821-a5bb-eaea7ea24e5e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:22:01.158009 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.222316 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] End _get_guest_xml xml=<domain type="qemu">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <uuid>5941cec5-ef65-4821-a5bb-eaea7ea24e5e</uuid>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <name>instance-00000050</name>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestVolumeBootPattern-server-1791632444</nova:name>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:21:57</nova:creationTime>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:image uuid="">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:user uuid="7980d292f588498685ffe894352e1443">tempest-TestVolumeBootPattern-1996194033-project-member</nova:user>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:project uuid="75f3a6b45e2d4a68b7fa986edb3c82a5">tempest-TestVolumeBootPattern-1996194033</nova:project>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:root type="volume" uuid=""/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         <nova:port uuid="fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <system>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="serial">5941cec5-ef65-4821-a5bb-eaea7ea24e5e</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="uuid">5941cec5-ef65-4821-a5bb-eaea7ea24e5e</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </system>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <os>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </os>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <features>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </features>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   <devices>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/disk.config"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </disk>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <disk type="block" device="disk">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <alias name="ua-784a0258-3180-4648-bbab-be999291c63b"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <source dev="/dev/dm-3"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <serial>784a0258-3180-4648-bbab-be999291c63b</serial>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </disk>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:9c:2a:18"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <target dev="tapfac4adb0-8e"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </interface>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/console.log" append="off"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </serial>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <video>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </video>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </rng>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:   </devices>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]: </domain>
May 13 02:22:01.222316 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Preparing to wait for external event network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1791632444',display_name='tempest-TestVolumeBootPattern-server-1791632444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1791632444',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cus9yfsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:21:54Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=5941cec5-ef65-4821-a5bb-eaea7ea24e5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:22:01.224416 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:01.224865 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:01.225182 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:22:01.225481 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.225698 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:01.225902 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:22:01.226471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.226602 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '196246a4-de15-5426-be6c-eb0be264af35', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:01.228477 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:01.230223 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.230399 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfac4adb0-8e, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:01.230705 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfac4adb0-8e, col_values=(('qos', UUID('5e634e1c-2b27-4235-a711-fe124ea67ed9')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:01.230899 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfac4adb0-8e, col_values=(('external_ids', {'iface-id': 'fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:2a:18', 'vm-uuid': '5941cec5-ef65-4821-a5bb-eaea7ea24e5e'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:01.231602 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.233418 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:01.236465 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:01.237412 np0000000663 nova-compute[98103]: INFO os_vif [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e')
May 13 02:22:01.817168 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00036122000028626644 future=<Future at 0x705c6c1b25a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:01.817862 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] Emitting event <LifecycleEvent: 1778638906.816695, 5f2a891b-623d-4145-b997-285c23394f55 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:01.818016 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] VM Stopped (Lifecycle Event)
May 13 02:22:01.818862 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:02.207748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:02.320487 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-800d04d0-75f1-40f6-8521-e89f708db080 tempest-TestMinimumBasicScenario-1453218982 tempest-TestMinimumBasicScenario-1453218982-project-member] [instance: 5f2a891b-623d-4145-b997-285c23394f55] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:02.752734 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:22:02.752889 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:22:02.752995 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] No VIF found with MAC fa:16:3e:9c:2a:18, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:22:02.753371 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Using config drive
May 13 02:22:03.258245 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:03.379854 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Creating config drive at /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/disk.config
May 13 02:22:03.382539 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmlct8es8 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:03.435523 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmlct8es8" returned: 0 in 0.053s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:03.824968 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:03.847768 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:03.948966 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:03.954512 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:03.955156 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:03.977740 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5b067169-3f7c-4cf5-b0de-248367b35583 req-7932b435-7874-4323-afd4-7b99c001cb8b service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:03.977740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5b067169-3f7c-4cf5-b0de-248367b35583 req-7932b435-7874-4323-afd4-7b99c001cb8b service nova] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:03.977740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5b067169-3f7c-4cf5-b0de-248367b35583 req-7932b435-7874-4323-afd4-7b99c001cb8b service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:03.977740 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-5b067169-3f7c-4cf5-b0de-248367b35583 req-7932b435-7874-4323-afd4-7b99c001cb8b service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:03.977740 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-5b067169-3f7c-4cf5-b0de-248367b35583 req-7932b435-7874-4323-afd4-7b99c001cb8b service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Processing event network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:22:04.146166 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:04.595766 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:22:04.596467 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638924.596049, 5941cec5-ef65-4821-a5bb-eaea7ea24e5e => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:04.596584 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] VM Started (Lifecycle Event)
May 13 02:22:04.598331 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:22:04.600589 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance spawned successfully.
May 13 02:22:04.601761 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:22:05.101916 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:05.104478 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:22:05.115250 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.115396 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.115725 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.115951 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.116192 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.116431 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:05.607901 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:22:05.608300 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638925.6079583, 5941cec5-ef65-4821-a5bb-eaea7ea24e5e => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:05.608300 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] VM Paused (Lifecycle Event)
May 13 02:22:05.621461 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Took 8.48 seconds to spawn the instance on the hypervisor.
May 13 02:22:05.621647 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:06.031374 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:06.031529 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:06.031702 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:06.032062 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:06.032241 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] No waiting events found dispatching network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:06.032350 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-04444152-002e-4f68-b927-556a2c1d055f req-21ffe8da-36b8-475f-b92f-1725ee8ed4eb service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received unexpected event network-vif-plugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 for instance with vm_state active and task_state None.
May 13 02:22:06.114621 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:06.117001 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638926.1168232, 5941cec5-ef65-4821-a5bb-eaea7ea24e5e => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:06.117127 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] VM Resumed (Lifecycle Event)
May 13 02:22:06.131459 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Took 16.27 seconds to build instance.
May 13 02:22:06.157881 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:06.158241 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:06.158435 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:06.158777 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:06.159040 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.72 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:22:06.166461 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:06.232432 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:06.619329 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:06.621716 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:22:06.632829 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-371e7caa-eb2b-4591-b6f3-1060f03cdba6 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.779s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:06.797480 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:06.797648 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:07.299577 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Starting instance... {{(pid=98103) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 13 02:22:07.855929 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:07.856298 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:07.860208 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98103) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 13 02:22:07.860401 np0000000663 nova-compute[98103]: INFO nova.compute.claims [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Claim successful on node np0000000663
May 13 02:22:07.883886 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:07.884071 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:07.884209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:22:07.884382 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:07.992428 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:07.992428 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing instance network info cache due to event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:22:07.992428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] Acquiring lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:07.992428 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] Acquired lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:07.992428 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing network info cache for port fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:22:08.391009 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:08.497102 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:08.770188 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:08.893116 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updated VIF entry in instance network info cache for port fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:22:08.893418 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:09.019872 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:22:09.020068 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:22:09.396155 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-c0b89516-7476-4d1c-ab0e-76137a1cad45 req-ecb592a0-e239-4710-b476-6dc1a843afa6 service nova] Releasing lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:09.522681 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:22:10.030421 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.174s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:10.031054 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.640s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:10.031312 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Start building networks asynchronously for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 13 02:22:10.033595 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:10.033753 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:22:10.174571 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:22:10.537368 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Allocating IP information in the background. {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 13 02:22:10.537755 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] allocate_for_instance() {{(pid=98103) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1187}}
May 13 02:22:10.538055 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:10.538333 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:10.599502 np0000000663 nova-compute[98103]: DEBUG nova.policy [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3758e5bd761e4e6e8e4b6322109b2a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e40c18799984d74acc2fdcf1bd54262', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98103) authorize /opt/stack/nova/nova/policy.py:192}}
May 13 02:22:10.972594 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Successfully created port: 20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:529}}
May 13 02:22:11.041595 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 13 02:22:11.053557 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:22:11.056127 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:22:11.058650 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:22:11.059602 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:11.110662 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:11.111033 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=13656MB free_disk=72.6416015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:22:11.111232 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:11.111506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:11.180903 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:11.233115 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:11.369148 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Successfully updated port: 20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) _update_port /opt/stack/nova/nova/network/neutron.py:567}}
May 13 02:22:11.414207 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-changed-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:11.414631 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Refreshing instance network info cache due to event network-changed-20df7c35-4692-43c9-acb5-aa430b9287c6. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:22:11.414830 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] Acquiring lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:11.414959 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] Acquired lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:11.415071 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Refreshing network info cache for port 20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:22:11.544779 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Start building block device mappings for instance. {{(pid=98103) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 13 02:22:11.871818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:11.916967 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:11.973064 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:22:12.099109 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:12.163407 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 3eb20366-64b5-4f14-91bd-74d4e11ecd4d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:22:12.163534 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 5941cec5-ef65-4821-a5bb-eaea7ea24e5e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:22:12.163614 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:22:12.163791 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:22:12.163909 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:22:11 up 46 min,  2 users,  load average: 3.87, 5.46, 5.11\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_75f3a6b45e2d4a68b7fa986edb3c82a5': '2', 'io_workload': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_5e40c18799984d74acc2fdcf1bd54262': '1'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:22:12.318490 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:22:12.318748 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:22:12.552141 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Start spawning the instance on the hypervisor. {{(pid=98103) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 13 02:22:12.553101 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Creating instance directory {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 13 02:22:12.553342 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Creating image(s)
May 13 02:22:12.553795 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:12.553948 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:12.554559 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:12.555209 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:22:12.557843 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:22:12.559001 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:12.601506 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f710d167-702a-4fd5-ad96-dc65f960870a req-74e45014-8f25-433e-b81c-567687dacbea service nova] Releasing lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:12.602104 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquired lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:12.602352 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Building network info cache for instance {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 13 02:22:12.645498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:12.645904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:12.646391 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:12.646859 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:22:12.649109 np0000000663 nova-compute[98103]: DEBUG oslo_utils.imageutils.format_inspector [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98103) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 13 02:22:12.649698 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:12.740402 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.090s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:12.741041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk 1073741824 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:12.800164 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0,backing_fmt=raw /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk 1073741824" returned: 0 in 0.059s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:12.800739 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "4d485ceea17443560116eff73e8ca3d0dadb11e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:12.801163 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:12.824468 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:22:12.897041 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d485ceea17443560116eff73e8ca3d0dadb11e0 --force-share --output=json" returned: 0 in 0.096s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:12.898874 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk. size=1073741824 {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 13 02:22:12.899303 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:12.994200 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:12.994677 np0000000663 nova-compute[98103]: DEBUG nova.virt.disk.api [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Cannot resize image /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk to a smaller size. {{(pid=98103) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 13 02:22:12.995104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Created local disks {{(pid=98103) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 13 02:22:12.995289 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Ensure instance console log exists: /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/console.log {{(pid=98103) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 13 02:22:12.995551 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:12.995805 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:12.995955 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:13.167828 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance cache missing network info. {{(pid=98103) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3362}}
May 13 02:22:13.333372 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:13.338618 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:22:13.338888 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.227s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:13.339308 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:22:13.446700 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating instance_info_cache with network_info: [{"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:13.948904 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Releasing lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:13.949189 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance network_info: |[{"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98103) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 13 02:22:13.950847 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Start _get_guest_xml network_info=[{"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encrypted': False, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_options': None, 'image_id': 'ce64da57-4ea7-4983-8f5e-9324f00e60fa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 13 02:22:13.955882 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:22:13.957180 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1926004108', uuid='9f6e3e9f-e010-4719-a59c-7cf8d87d6df6'), owner=OwnerMeta(userid='3758e5bd761e4e6e8e4b6322109b2a08', username='tempest-TestServerVolumeAttachmentScenario-401205016-project-member', projectid='5e40c18799984d74acc2fdcf1bd54262', projectname='tempest-TestServerVolumeAttachmentScenario-401205016'), image=ImageMeta(id='ce64da57-4ea7-4983-8f5e-9324f00e60fa', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1778638933.9568279) {{(pid=98103) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 13 02:22:13.976807 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V1... {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 13 02:22:13.977195 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CPU controller missing on host. {{(pid=98103) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 13 02:22:13.978248 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching host: 'np0000000663' for CPU controller through CGroups V2... {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 13 02:22:13.978456 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.host [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CPU controller found on host. {{(pid=98103) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 13 02:22:13.979407 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98103) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 13 02:22:13.979734 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-13T02:00:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-13T02:00:08Z,direct_url=<?>,disk_format='qcow2',id=ce64da57-4ea7-4983-8f5e-9324f00e60fa,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='4f893ea06521473e932cf414ddb173aa',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-13T02:00:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 13 02:22:13.979928 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Flavor limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 13 02:22:13.980063 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Image limits 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 13 02:22:13.980230 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Flavor pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 13 02:22:13.980356 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Image pref 0:0:0 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 13 02:22:13.980513 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 13 02:22:13.980697 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 13 02:22:13.980859 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 13 02:22:13.981005 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Got 1 possible topologies {{(pid=98103) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 13 02:22:13.981173 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 13 02:22:13.981365 np0000000663 nova-compute[98103]: DEBUG nova.virt.hardware [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98103) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 13 02:22:13.991102 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1926004108',display_name='tempest-TestServerVolumeAttachmentScenario-server-1926004108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachmentscenario-server-1926004108',id=81,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIf1YM/0K80ledoHvQy3WQ2tjNyQUH2CX9EcsAwmmHJb0b/2pzmlHYWxYlKE7UYvS+GhgDZ8ifa9u/58We7Tu7V7zS/AE4MZ/UUoa9ppNXRJ5Hl8OutWoHoQkPyIMiag==',key_name='tempest-keypair-423622502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e40c18799984d74acc2fdcf1bd54262',ramdisk_id='',reservation_id='r-hn07899z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-401205016',owner_user_name='tempest-TestServerVolumeAttachmentScenario-401205016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3758e5bd761e4e6e8e4b6322109b2a08',uuid=9f6e3e9f-e010-4719-a59c-7cf8d87d6df6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98103) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:598}}
May 13 02:22:13.991322 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converting VIF {"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:13.991760 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:13.992249 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:22:14.339060 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:14.339333 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:22:14.339594 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.54 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:22:14.494664 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] End _get_guest_xml xml=<domain type="qemu">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <uuid>9f6e3e9f-e010-4719-a59c-7cf8d87d6df6</uuid>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <name>instance-00000051</name>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <memory>196608</memory>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <vcpu>1</vcpu>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <metadata>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:package version="33.1.0"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1926004108</nova:name>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:creationTime>2026-05-13 02:22:13</nova:creationTime>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:flavor name="m1.nano" id="42">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:memory>192</nova:memory>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:disk>1</nova:disk>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:swap>0</nova:swap>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:ephemeral>0</nova:ephemeral>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:vcpus>1</nova:vcpus>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:extraSpecs>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         </nova:extraSpecs>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       </nova:flavor>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:image uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:containerFormat>bare</nova:containerFormat>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:minDisk>1</nova:minDisk>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:minRam>0</nova:minRam>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:properties>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         </nova:properties>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       </nova:image>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:owner>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:user uuid="3758e5bd761e4e6e8e4b6322109b2a08">tempest-TestServerVolumeAttachmentScenario-401205016-project-member</nova:user>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:project uuid="5e40c18799984d74acc2fdcf1bd54262">tempest-TestServerVolumeAttachmentScenario-401205016</nova:project>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       </nova:owner>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:root type="image" uuid="ce64da57-4ea7-4983-8f5e-9324f00e60fa"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <nova:ports>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         <nova:port uuid="20df7c35-4692-43c9-acb5-aa430b9287c6">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:         </nova:port>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       </nova:ports>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </nova:instance>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </metadata>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <sysinfo type="smbios">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <system>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="product">OpenStack Nova</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="version">33.1.0</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="serial">9f6e3e9f-e010-4719-a59c-7cf8d87d6df6</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="uuid">9f6e3e9f-e010-4719-a59c-7cf8d87d6df6</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <entry name="family">Virtual Machine</entry>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </system>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </sysinfo>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <os>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <type arch="x86_64" machine="pc">hvm</type>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <boot dev="hd"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <smbios mode="sysinfo"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </os>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <features>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <acpi/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <tcg>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <tb-cache unit="MiB">128</tb-cache>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </tcg>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <vmcoreinfo/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </features>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <iothreads>1</iothreads>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <clock offset="utc"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <cpu mode="custom" match="exact">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <model>Nehalem</model>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <topology sockets="1" cores="1" threads="1"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </cpu>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   <devices>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <disk type="file" device="disk">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <driver name="qemu" type="qcow2" cache="none"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <target dev="vda" bus="virtio"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </disk>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <disk type="file" device="cdrom">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <driver name="qemu" type="raw" cache="none"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <source file="/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.config"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <target dev="hda" bus="ide"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </disk>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <interface type="ethernet">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <mac address="fa:16:3e:d9:dc:2f"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <driver name="qemu"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <mtu size="1372"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <target dev="tap20df7c35-46"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </interface>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <serial type="pty">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <log file="/opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/console.log" append="off"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </serial>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <video>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <model type="virtio"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </video>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <rng model="virtio">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <backend model="random">/dev/urandom</backend>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </rng>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <controller type="usb" index="0" model="none"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:       <stats period="10"/>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:     </memballoon>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:   </devices>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]: </domain>
May 13 02:22:14.494664 np0000000663 nova-compute[98103]:  {{(pid=98103) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Preparing to wait for external event network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-13T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1926004108',display_name='tempest-TestServerVolumeAttachmentScenario-server-1926004108',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachmentscenario-server-1926004108',id=81,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIf1YM/0K80ledoHvQy3WQ2tjNyQUH2CX9EcsAwmmHJb0b/2pzmlHYWxYlKE7UYvS+GhgDZ8ifa9u/58We7Tu7V7zS/AE4MZ/UUoa9ppNXRJ5Hl8OutWoHoQkPyIMiag==',key_name='tempest-keypair-423622502',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e40c18799984d74acc2fdcf1bd54262',ramdisk_id='',reservation_id='r-hn07899z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-401205016',owner_user_name='tempest-TestServerVolumeAttachmentScenario-401205016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-13T02:22:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3758e5bd761e4e6e8e4b6322109b2a08',uuid=9f6e3e9f-e010-4719-a59c-7cf8d87d6df6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) plug /opt/stack/nova/nova/virt/libvirt/vif.py:763}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converting VIF {"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:14.497357 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:14.497782 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46') {{(pid=98103) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:76}}
May 13 02:22:14.497965 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.498316 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:14.498610 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 13 02:22:14.499325 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.499507 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3294bb29-d1a9-57f2-a803-36010f996be6', '_type': 'linux-noop'}}, row=False) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:14.500308 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.500935 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:14.501254 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.502881 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.503007 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20df7c35-46, may_exist=True, interface_attrs={}) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:14.503314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20df7c35-46, col_values=(('qos', UUID('b15d71e2-3d95-4435-ac33-38204b71e07b')),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:14.503468 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20df7c35-46, col_values=(('external_ids', {'iface-id': '20df7c35-4692-43c9-acb5-aa430b9287c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:dc:2f', 'vm-uuid': '9f6e3e9f-e010-4719-a59c-7cf8d87d6df6'}),), if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:14.504043 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.505816 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:14.510187 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:14.510898 np0000000663 nova-compute[98103]: INFO os_vif [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46')
May 13 02:22:16.030758 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:22:16.031071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:22:16.031071 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No VIF found with MAC fa:16:3e:d9:dc:2f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:22:16.031317 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Using config drive
May 13 02:22:16.188566 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:16.537282 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:16.643011 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Creating config drive at /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.config
May 13 02:22:16.646522 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjhyvfqg8 {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:16.698667 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjhyvfqg8" returned: 0 in 0.052s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:22:17.096471 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.118501 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.119767 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.211155 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.311457 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9ec40a19-5e4a-4c38-9a8d-c3229d0a9241 req-92c13400-c810-4f29-a384-b74247024578 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:17.311900 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ec40a19-5e4a-4c38-9a8d-c3229d0a9241 req-92c13400-c810-4f29-a384-b74247024578 service nova] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:17.312222 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ec40a19-5e4a-4c38-9a8d-c3229d0a9241 req-92c13400-c810-4f29-a384-b74247024578 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:17.312432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-9ec40a19-5e4a-4c38-9a8d-c3229d0a9241 req-92c13400-c810-4f29-a384-b74247024578 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:17.312633 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-9ec40a19-5e4a-4c38-9a8d-c3229d0a9241 req-92c13400-c810-4f29-a384-b74247024578 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Processing event network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 13 02:22:17.415318 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.417013 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.419244 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.437749 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:17.821206 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638937.8206513, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => Started> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:17.821341 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] VM Started (Lifecycle Event)
May 13 02:22:17.823997 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98103) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 13 02:22:17.829113 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Guest created on hypervisor {{(pid=98103) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 13 02:22:17.830845 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance spawned successfully.
May 13 02:22:17.831356 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 13 02:22:18.325621 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:18.327733 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:22:18.340645 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_cdrom_bus of ide {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.340785 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_disk_bus of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.341107 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_input_bus of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.341427 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_pointer_model of None {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.341745 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_video_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.342017 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Found default for hw_vif_model of virtio {{(pid=98103) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 13 02:22:18.829941 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] During sync_power_state the instance has a pending task (spawning). Skip.
May 13 02:22:18.830278 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638938.8300154, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => Paused> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:18.830437 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] VM Paused (Lifecycle Event)
May 13 02:22:18.849531 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Took 6.30 seconds to spawn the instance on the hypervisor.
May 13 02:22:18.849898 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:19.332771 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:19.340286 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Emitting event <LifecycleEvent: 1778638939.3400571, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => Resumed> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:22:19.340399 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] VM Resumed (Lifecycle Event)
May 13 02:22:19.367423 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Took 11.56 seconds to build instance.
May 13 02:22:19.375740 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:19.376258 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:19.376461 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:19.376642 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:19.376830 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] No waiting events found dispatching network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:19.376986 np0000000663 nova-compute[98103]: WARNING nova.compute.manager [req-a9148b7b-7a60-4273-9b2b-0cfe42e90a7a req-1396d03e-6ee1-4316-909d-8ceb02ea9f99 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received unexpected event network-vif-plugged-20df7c35-4692-43c9-acb5-aa430b9287c6 for instance with vm_state active and task_state None.
May 13 02:22:19.505862 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:19.842932 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:22:19.850117 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98103) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 13 02:22:19.868818 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.071s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:20.660450 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-changed-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:20.660784 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Refreshing instance network info cache due to event network-changed-20df7c35-4692-43c9-acb5-aa430b9287c6. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:22:20.660784 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] Acquiring lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:20.660969 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] Acquired lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:20.660969 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Refreshing network info cache for port 20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:22:21.163388 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:21.205360 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:21.466706 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:21.590588 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updated VIF entry in instance network info cache for port 20df7c35-4692-43c9-acb5-aa430b9287c6. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:22:21.590863 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating instance_info_cache with network_info: [{"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:22.092780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-0733d9e3-86f1-4124-8847-9480bb878479 req-c8b9aeaa-cb03-415d-9669-a35c58bd2179 service nova] Releasing lock "refresh_cache-9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:24.509285 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:26.218042 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:29.512241 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:31.219334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:34.515342 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:36.220492 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:39.517588 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:41.230762 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:44.519950 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:44.531545 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:44.531545 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing instance network info cache due to event network-changed-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:22:44.531717 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] Acquiring lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:44.531766 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] Acquired lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:44.531866 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Refreshing network info cache for port fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:22:45.034354 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:45.034500 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:45.034665 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:45.034787 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:45.034879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:45.036601 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:45.039106 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Terminating instance
May 13 02:22:45.339379 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:45.486349 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updated VIF entry in instance network info cache for port fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:22:45.486666 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [{"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:45.543489 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:22:45.562131 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.563892 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.582504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.691668 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.697998 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.708760 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:45.709067 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:45.709332 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:45.709503 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:45.709736 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] No waiting events found dispatching network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:45.709879 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-4faf89ad-db0a-4a14-a73a-42c814843426 req-da2f035e-14a4-43e9-8922-ce2bbdf99296 service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:22:45.753614 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:45.872618 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999653846000001 future=<Future at 0x705c6c190860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:45.872812 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.99935867799968 future=<Future at 0x705c6c190860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:45.873155 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999036108999917 future=<Future at 0x705c6c190860 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:45.877030 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Instance destroyed successfully.
May 13 02:22:45.877563 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 5941cec5-ef65-4821-a5bb-eaea7ea24e5e {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:22:45.988396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-a793b964-36b0-42f1-b134-7a990129ff19 req-5f62970c-5f65-4cf0-8fb9-35bf756872ab service nova] Releasing lock "refresh_cache-5941cec5-ef65-4821-a5bb-eaea7ea24e5e" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:46.245595 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.382985 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:21:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1791632444',display_name='tempest-TestVolumeBootPattern-server-1791632444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-1791632444',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:22:05Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-cus9yfsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:22:06Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=5941cec5-ef65-4821-a5bb-eaea7ea24e5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:22:46.383299 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "address": "fa:16:3e:9c:2a:18", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfac4adb0-8e", "ovs_interfaceid": "fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:46.383718 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:46.383920 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:22:46.385111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.385354 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfac4adb0-8e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:46.386266 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.386918 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:46.387084 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.387618 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.387744 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e634e1c-2b27-4235-a711-fe124ea67ed9) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:46.388444 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:46.388509 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:46.390194 np0000000663 nova-compute[98103]: INFO os_vif [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:2a:18,bridge_name='br-int',has_traffic_filtering=True,id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfac4adb0-8e')
May 13 02:22:46.391797 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:22:46.392059 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:22:46.392208 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:22:46.392508 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:22:46.392790 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '784a0258-3180-4648-bbab-be999291c63b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:22:46.392946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:22:46.415203 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:46.415203 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:46.415203 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:22:46.415203 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:22:46.415203 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:22:46.415445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:46.415445 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:46.415445 np0000000663 nova-compute[98103]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:22:46.415445 np0000000663 nova-compute[98103]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b (non-flash)
May 13 02:22:46.415445 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:22:46.415445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', '224')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:22:46.415592 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', '223')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:22:46.416299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b', '224')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:22:46.416902 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c4878c040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:22:46.417109 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:22:46.417325 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 330000000f58ad14a {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:22:46.461376 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:22:46.510503 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:22:46.566676 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:22:46.567053 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:22:46.567739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:22:46.578557 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:22:46.578789 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:22:46.588948 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.612582 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.40.100,3260]
May 13 02:22:46.612582 np0000000663 nova-compute[98103]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.40.100,3260] successful.
May 13 02:22:46.612582 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.625395 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.635796 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.659854 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.50.100,3260]
May 13 02:22:46.659854 np0000000663 nova-compute[98103]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-784a0258-3180-4648-bbab-be999291c63b, portal: 192.168.50.100,3260] successful.
May 13 02:22:46.659854 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.672290 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:46.672477 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:22:46.672593 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (279ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:22:46.672723 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:22:46.672966 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Deleting instance files /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e_del
May 13 02:22:46.673410 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Deletion of /opt/stack/data/nova/instances/5941cec5-ef65-4821-a5bb-eaea7ea24e5e_del complete
May 13 02:22:47.178934 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Took 1.64 seconds to destroy the instance on the hypervisor.
May 13 02:22:47.180180 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:22:47.180470 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:22:47.180552 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:22:47.180781 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:47.265359 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:47.759167 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:47.759485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] Acquiring lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:47.759485 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:47.759593 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:47.759712 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] No waiting events found dispatching network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:47.759819 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-unplugged-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:22:47.760280 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Received event network-vif-deleted-fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:47.760404 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Neutron deleted interface fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4; detaching it from the instance and deleting it from the info cache
May 13 02:22:47.760533 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:47.947373 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:48.263872 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-81fd2f9d-573b-4c38-a881-83312c817ebd req-0e950ddc-05ef-4e8a-b19f-23fe2c8b3d8a service nova] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Detach interface failed, port_id=fac4adb0-8e8a-4fb9-80cf-778a2a8cc6b4, reason: Instance 5941cec5-ef65-4821-a5bb-eaea7ea24e5e could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:22:48.449170 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Took 1.27 seconds to deallocate network for instance.
May 13 02:22:48.986736 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Took 0.54 seconds to detach 1 volumes for instance.
May 13 02:22:49.491729 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:49.491891 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:49.649383 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:22:49.649568 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:22:50.152589 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:22:50.658708 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.167s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:50.698446 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 5941cec5-ef65-4821-a5bb-eaea7ea24e5e
May 13 02:22:51.247217 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:51.388748 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:51.705994 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-2da3c74b-8068-43d5-95e9-6367d6ab1698 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "5941cec5-ef65-4821-a5bb-eaea7ea24e5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.671s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:54.353183 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:54.354265 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing instance network info cache due to event network-changed-2315ee0a-1ee0-4610-ad96-6db2ca00013a. {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 13 02:22:54.354265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] Acquiring lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}}
May 13 02:22:54.354265 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] Acquired lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}}
May 13 02:22:54.354265 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Refreshing network info cache for port 2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 13 02:22:54.857187 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:54.870866 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:54.871875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:54.871875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:54.871875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:54.871875 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:54.873541 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Terminating instance
May 13 02:22:55.105612 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:55.216989 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updated VIF entry in instance network info cache for port 2315ee0a-1ee0-4610-ad96-6db2ca00013a. {{(pid=98103) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3521}}
May 13 02:22:55.217240 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [{"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:55.376209 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:22:55.389550 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:55.391551 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:55.404314 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:55.405778 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:55.422174 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:55.503848 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:55.504241 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:55.504484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:55.504484 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:55.504780 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] No waiting events found dispatching network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:55.504873 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-e8affcbb-eff4-4374-9dbd-645e314a3506 req-46596f6d-47f0-4fd7-9882-f7bf1cbd9b41 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:22:55.683461 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999726100999851 future=<Future at 0x705c6c2b7740 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:22:55.685457 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Instance destroyed successfully.
May 13 02:22:55.685789 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lazy-loading 'resources' on Instance uuid 3eb20366-64b5-4f14-91bd-74d4e11ecd4d {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:22:55.719026 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-1f259aa1-b25a-4b15-8c0d-ef3814e085ec req-9378a057-92bd-4860-9c3f-75f500d0a073 service nova] Releasing lock "refresh_cache-3eb20366-64b5-4f14-91bd-74d4e11ecd4d" {{(pid=98103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}}
May 13 02:22:56.188788 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-345927682',display_name='tempest-TestVolumeBootPattern-server-345927682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testvolumebootpattern-server-345927682',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk6U0Mhe0w2ukcd0bkTiJIUl0mxkyxsEXMx0gqTHfdMbFoQQkcNWSIHCmVvBaOtqTL3eCEqoNmDu7x7qL0N3kzKxh4o/bhs87Bwlz1MqCdvY6IKipGTulndhl7HJLrvPg==',key_name='tempest-TestVolumeBootPattern-22182927',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:21:06Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75f3a6b45e2d4a68b7fa986edb3c82a5',ramdisk_id='',reservation_id='r-kx7ff037',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1996194033',owner_user_name='tempest-TestVolumeBootPattern-1996194033-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:21:07Z,user_data=None,user_id='7980d292f588498685ffe894352e1443',uuid=3eb20366-64b5-4f14-91bd-74d4e11ecd4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:22:56.189035 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converting VIF {"id": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "address": "fa:16:3e:5f:f3:ed", "network": {"id": "aefe0e26-7599-44f9-a537-1c824f8bd697", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1079381469-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "75f3a6b45e2d4a68b7fa986edb3c82a5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2315ee0a-1e", "ovs_interfaceid": "2315ee0a-1ee0-4610-ad96-6db2ca00013a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:22:56.189496 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:22:56.189717 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:22:56.190489 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:56.190676 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2315ee0a-1e, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:56.211504 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:56.212142 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:56.212458 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:56.213005 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:56.213152 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1969ddc-dbb0-48c9-8a5b-f8e0cab27138) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:22:56.213582 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:22:56.214105 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:22:56.215489 np0000000663 nova-compute[98103]: INFO os_vif [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:f3:ed,bridge_name='br-int',has_traffic_filtering=True,id=2315ee0a-1ee0-4610-ad96-6db2ca00013a,network=Network(aefe0e26-7599-44f9-a537-1c824f8bd697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2315ee0a-1e')
May 13 02:22:56.217235 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:22:56.217514 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:22:56.217679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:22:56.217983 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:22:56.218264 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:22:56.218402 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:22:56.238412 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:56.238412 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:56.238412 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:22:56.238641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsi session list stdout=tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:56.238641 np0000000663 nova-compute[98103]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643 (non-flash)
May 13 02:22:56.238641 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:22:56.238641 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:22:56.238816 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '219')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:22:56.239527 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643', '220')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:22:56.240107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c70bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:22:56.240299 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:22:56.240494 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Flush multipath device 330000000bc7bdbad {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:22:56.295328 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:22:56.339557 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:22:56.389538 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:22:56.389891 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:22:56.390364 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:22:56.400484 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:22:56.400686 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:22:56.410396 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.432787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260]
May 13 02:22:56.432787 np0000000663 nova-compute[98103]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.40.100,3260] successful.
May 13 02:22:56.432787 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.445371 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.454386 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.483105 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260]
May 13 02:22:56.483105 np0000000663 nova-compute[98103]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-8009b6b3-8da6-4b8e-b848-77d2d2d8d643, portal: 192.168.50.100,3260] successful.
May 13 02:22:56.483105 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.492820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:22:56.493010 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:22:56.493149 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] <== disconnect_volume: return (275ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:22:56.493261 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:22:56.493480 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Deleting instance files /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d_del
May 13 02:22:56.493953 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Deletion of /opt/stack/data/nova/instances/3eb20366-64b5-4f14-91bd-74d4e11ecd4d_del complete
May 13 02:22:56.904672 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:56.904821 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:56.999824 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Took 1.62 seconds to destroy the instance on the hypervisor.
May 13 02:22:57.001755 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:22:57.001995 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:22:57.002140 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:22:57.002265 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:57.056318 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:22:57.292330 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4e54ceb-5eba-4415-af8b-033b2815b196 req-09f94422-b4e9-49e2-b1ed-d7fa45ea1a49 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-deleted-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:57.292478 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-b4e54ceb-5eba-4415-af8b-033b2815b196 req-09f94422-b4e9-49e2-b1ed-d7fa45ea1a49 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Neutron deleted interface 2315ee0a-1ee0-4610-ad96-6db2ca00013a; detaching it from the instance and deleting it from the info cache
May 13 02:22:57.292546 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-b4e54ceb-5eba-4415-af8b-033b2815b196 req-09f94422-b4e9-49e2-b1ed-d7fa45ea1a49 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:57.407472 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:22:57.556291 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:22:57.556513 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] Acquiring lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:57.556749 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:57.557053 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:57.557210 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] No waiting events found dispatching network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:22:57.557315 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-d429d2bf-bbee-4fbe-badd-d280abc364c2 req-bf0c22f7-c730-43af-b176-0bd47a07e99c service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Received event network-vif-unplugged-2315ee0a-1ee0-4610-ad96-6db2ca00013a for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:22:57.734958 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:22:57.795639 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-b4e54ceb-5eba-4415-af8b-033b2815b196 req-09f94422-b4e9-49e2-b1ed-d7fa45ea1a49 service nova] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Detach interface failed, port_id=2315ee0a-1ee0-4610-ad96-6db2ca00013a, reason: Instance 3eb20366-64b5-4f14-91bd-74d4e11ecd4d could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:22:58.236812 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Took 1.23 seconds to deallocate network for instance.
May 13 02:22:58.411678 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:22:58.777777 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Took 0.54 seconds to detach 1 volumes for instance.
May 13 02:22:59.283157 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:59.283288 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:59.401109 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:22:59.401395 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:22:59.474045 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:22:59.474451 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:22:59.474451 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attaching volume 58b6feae-2c40-4f57-9419-3ef8ff525542 to /dev/vdb
May 13 02:22:59.506007 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:22:59.515646 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:22:59.531878 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:22:59.574766 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:22:59.574994 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:22:59.583418 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:22:59.584351 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fed9:dc2f', 'fe80::d08a:c0ff:fe16:a625'] 
May 13 02:22:59.584489 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:22:59.584635 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:22:59.584889 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== get_connector_properties: return (78ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:22:59.585181 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating existing volume attachment record: e5ef594f-bc90-457f-827d-e2ceaef83d58 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:22:59.904228 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:23:00.131150 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:23:00.131531 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:23:00.131720 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:00.132198 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:00.132416 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:23:00.145705 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:00.146107 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:00.146285 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:23:00.147207 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:00.147930 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:00.148663 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:23:00.156865 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:23:00.156865 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:00.162360 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:23:00.162360 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:00.169345 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542] added
May 13 02:23:00.169345 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:23:00.169345 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:00.169345 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:00.169345 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:00.169345 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:00.169345 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:00.169678 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:23:00.169968 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:23:00.169968 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:23:00.173020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542] added
May 13 02:23:00.173020 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:23:00.173020 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:00.173020 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:00.173020 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:00.173020 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:00.173020 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:00.173191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:23:00.173385 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:23:00.173569 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:23:00.410646 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:00.459863 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Deleted allocations for instance 3eb20366-64b5-4f14-91bd-74d4e11ecd4d
May 13 02:23:00.872647 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.0004075400001966045 future=<Future at 0x705c6c190860 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:00.873124 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Emitting event <LifecycleEvent: 1778638965.872082, 5941cec5-ef65-4821-a5bb-eaea7ea24e5e => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:23:00.873239 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:00.873494 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] VM Stopped (Lifecycle Event)
May 13 02:23:00.874689 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.80846634799991 future=<Future at 0x705c6c2b7740 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:00.875361 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=9.807784341000115 future=<Future at 0x705c6c2b7740 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:01.170416 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:23:01.173904 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:23:01.182058 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:23:01.182058 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:23:01.187585 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:23:01.187585 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.192341 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.198509 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.203831 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:23:01.203831 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:01.203928 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:23:01.203928 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:01.204024 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:23:01.204024 np0000000663 nova-compute[98103]: 
May 13 02:23:01.209473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 13 02:23:01.209473 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:01.209798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 13 02:23:01.209798 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:01.209878 np0000000663 nova-compute[98103]: WARNING os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 13 02:23:01.209878 np0000000663 nova-compute[98103]: 
May 13 02:23:01.221010 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:01.232285 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.40.100,3260]
May 13 02:23:01.232285 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.40.100,3260] successful.
May 13 02:23:01.232285 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.237652 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.50.100,3260]
May 13 02:23:01.237652 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.50.100,3260] successful.
May 13 02:23:01.237652 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.243814 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.248129 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:01.251685 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:01.258938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.258938 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.258938 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:01.258938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.258938 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.258938 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:01.259183 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.113s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:01.259241 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:23:01.259721 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:23:01.259820 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:23:01.264298 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.264298 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.264298 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:01.264473 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.264473 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:01.264473 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:01.264558 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:01.264670 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:23:01.265025 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:23:01.265136 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:23:01.274247 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:23:01.274247 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:23:01.283011 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:23:01.283191 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:23:01.376049 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 5941cec5-ef65-4821-a5bb-eaea7ea24e5e] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:23:01.468289 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-f2f1edf6-4718-4cb5-b8e2-715c9839c215 tempest-TestVolumeBootPattern-1996194033 tempest-TestVolumeBootPattern-1996194033-project-member] Lock "3eb20366-64b5-4f14-91bd-74d4e11ecd4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.597s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:02.148463 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:787}}
May 13 02:23:03.163237 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found WWN 3300000006d4fcb67 for multipath device dm-0 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:23:03.163614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:03.163614 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000006d4fcb67', 'path': '/dev/dm-0', 'multipath_id': '3300000006d4fcb67'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:23:03.163767 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006d4fcb67', 'path': '/dev/dm-0', 'multipath_id': '3300000006d4fcb67'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:23:03.166702 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:03.669307 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attempting to attach volume 58b6feae-2c40-4f57-9419-3ef8ff525542 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:23:03.670830 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:   <alias name="ua-58b6feae-2c40-4f57-9419-3ef8ff525542"/>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:   <serial>58b6feae-2c40-4f57-9419-3ef8ff525542</serial>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:03.670830 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:23:03.878485 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:03.878791 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:23:03.883691 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:03.883884 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:03.884114 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:23:03.885246 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:05.299276 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:05.312365 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:05.312620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:05.312620 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:05.312705 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No VIF found with MAC fa:16:3e:d9:dc:2f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:23:06.223111 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:06.861158 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-090ccab9-005b-463d-80c6-aa9ae660f8d8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.387s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:06.884024 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:06.884381 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:23:07.883925 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:07.884265 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:07.884305 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:23:07.884520 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:23:08.540437 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:08.540599 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:09.043608 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:09.883995 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:09.884197 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:23:10.049454 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:10.388445 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:10.388577 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:10.388671 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:10.388896 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:23:10.683517 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00032136499976331834 future=<Future at 0x705c6c2b7740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:10.683793 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] Emitting event <LifecycleEvent: 1778638975.6830595, 3eb20366-64b5-4f14-91bd-74d4e11ecd4d => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:23:10.683913 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:10.684026 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] VM Stopped (Lifecycle Event)
May 13 02:23:11.102560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:11.103014 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:11.103014 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attaching volume 40fa8b7a-1c4b-4790-bab6-852756f9c771 to /dev/vdc
May 13 02:23:11.139197 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.38', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000000663', 'execute': None}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:23:11.149211 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.scaleio [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98103) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 13 02:23:11.168432 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Running cmd (subprocess): nvme version {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:23:11.188222 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-0fa375a6-5b6d-47d4-9079-15c2fd56233b tempest-TestVolumeBootPatternV346-1111989009 tempest-TestVolumeBootPatternV346-1111989009-project-member] [instance: 3eb20366-64b5-4f14-91bd-74d4e11ecd4d] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:23:11.210468 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] 'nvme version' failed. Not Retrying. {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 13 02:23:11.210743 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] nvme not present on system {{(pid=98103) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 13 02:23:11.218005 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98103) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 13 02:23:11.218834 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.lightos [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Current host hostNQN  and IP(s) are ['10.4.3.38', 'fe80::f816:3eff:fefe:d73c', '192.168.40.6', 'fe80::f816:3eff:fea3:ae10', '192.168.50.6', 'fe80::f816:3eff:fe7c:ae63', '192.168.10.6', 'fe80::f816:3eff:fee4:ab8', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::345a:5ff:fe5e:4d46', 'fe80::fc16:3eff:fed9:dc2f', 'fe80::d08a:c0ff:fe16:a625'] 
May 13 02:23:11.218947 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 13 02:23:11.219043 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.lightos [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] LIGHTOS: no hostnqn found. {{(pid=98103) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 13 02:23:11.219252 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.38', 'host': 'np0000000663', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:7ab0f912cdcc', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '275aca93-7ffc-4ab6-ac4d-09848357451e', 'nvme_native_multipath': False} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:23:11.219463 np0000000663 nova-compute[98103]: DEBUG nova.virt.block_device [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating existing volume attachment record: c83fb034-d6b6-4b93-903e-1894720ff441 {{(pid=98103) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 13 02:23:11.228294 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:11.228602 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:11.228699 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:23:11.228782 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:11.238979 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:11.239169 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:11.409161 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:23:11.495117 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:23:11.495560 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:23:11.581396 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:23:11.581798 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98103) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 13 02:23:11.586031 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:23:11.587250 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:23:11.632049 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:23:11.632372 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=13878MB free_disk=72.59302520751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:23:11.632498 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:11.632757 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:11.779203 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Calling os-brick to attach iSCSI Volume {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 13 02:23:11.779656 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:23:11.779844 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:11.780277 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:11.780522 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 13 02:23:11.793408 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:11.794044 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:11.794549 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:11.794760 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:23:11.795200 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:11.795514 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:23:11.805072 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:23:11.805072 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:11.809649 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 13 02:23:11.809649 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:11.816769 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771] added
May 13 02:23:11.816769 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:23:11.816769 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:11.816769 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:11.816769 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:11.816769 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:11.816769 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:11.817068 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:23:11.817197 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:23:11.817243 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:23:11.821798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771] added
May 13 02:23:11.821798 np0000000663 nova-compute[98103]:  stderr=iscsiadm: Config file line 363 does not have value
May 13 02:23:11.821798 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:11.821798 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:11.821798 np0000000663 nova-compute[98103]: iscsiadm: Config file line 363 does not have value
May 13 02:23:11.821798 np0000000663 nova-compute[98103]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 13 02:23:11.821798 np0000000663 nova-compute[98103]:  {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:11.822258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98103) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1158}}
May 13 02:23:11.822258 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 13 02:23:11.822386 np0000000663 nova-compute[98103]: DEBUG os_brick.utils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98103) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 13 02:23:12.692904 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98103) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 13 02:23:12.693349 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:23:12.693349 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:23:11 up 47 min,  2 users,  load average: 2.32, 4.73, 4.88\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_5e40c18799984d74acc2fdcf1bd54262': '1', 'io_workload': '0'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:23:12.772129 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:23:12.772338 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:23:12.817963 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 13 02:23:12.822828 np0000000663 nova-compute[98103]: INFO os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.40.100
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:23:12.830959 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:23:12.830959 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.name = iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.tpgt = -1
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.startup = manual
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.leading_login = No
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.iscsi_ifacename = default
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.net_ifacename = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.ipaddress = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.prefix_len = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.hwaddress = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.transport_name = tcp
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.initiatorname = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.vlan_id = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.vlan_priority = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.vlan_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.iface_num = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.mtu = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.port = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.bootproto = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.subnet_mask = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.gateway = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_alt_client_id = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_dns = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_learn_iqn = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_req_vendor_id_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_vendor_id = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.dhcp_slp_da = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.fragmentation = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.gratuitous_arp = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.incoming_forwarding = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tos_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tos = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.ttl = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.delayed_ack = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tcp_nagle = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tcp_wsf_state = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tcp_wsf = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tcp_timer_scale = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.tcp_timestamp = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.redirect = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.def_task_mgmt_timeout = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.header_digest = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.data_digest = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.immediate_data = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.initial_r2t = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.data_seq_inorder = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.data_pdu_inorder = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.erl = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.max_receive_data_len = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.first_burst_len = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.max_outstanding_r2t = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.max_burst_len = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.chap_auth = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.bidi_chap = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.strict_login_compliance = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.discovery_auth = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: iface.discovery_logout = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.discovery_address = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.discovery_port = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.discovery_type = fw
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.initial_cmdsn = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.initial_login_retry_max = 8
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.xmit_thread_priority = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.cmds_max = 128
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.queue_depth = 32
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.nr_sessions = 1
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.authmethod = None
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.username = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.password = ***
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.username_in = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.password_in = <empty>
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.auth.chap_algs = SHA256
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.timeo.replacement_timeout = 120
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.err_timeo.abort_timeout = 15
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.err_timeo.lu_reset_timeout = 30
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.err_timeo.tgt_reset_timeout = 30
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.err_timeo.host_reset_timeout = 60
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.FastAbort = Yes
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.InitialR2T = No
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.ImmediateData = Yes
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.FirstBurstLength = 262144
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.MaxBurstLength = 16776192
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Retain = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.DefaultTime2Wait = 2
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.MaxConnections = 1
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.MaxOutstandingR2T = 1
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.iscsi.ERL = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.scan = auto
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.session.reopen_max = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].address = 192.168.50.100
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].port = 3260
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].startup = manual
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].tcp.window_size = 524288
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].tcp.type_of_service = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].timeo.logout_timeout = 15
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].timeo.login_timeout = 15
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].timeo.auth_timeout = 45
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_interval = 5
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].timeo.noop_out_timeout = 5
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.HeaderDigest = None
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.DataDigest = None
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.IFMarker = No
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: node.conn[0].iscsi.OFMarker = No
May 13 02:23:12.836751 np0000000663 nova-compute[98103]: # END RECORD
May 13 02:23:12.836751 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.842329 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.849877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.854958 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.854958 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.854958 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:12.855154 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.855154 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.855154 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:12.862001 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.862001 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.862001 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:12.862165 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.862165 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.862165 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:12.885455 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.40.100,3260]
May 13 02:23:12.885455 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.40.100,3260] successful.
May 13 02:23:12.885455 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.897539 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.903787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.50.100,3260]
May 13 02:23:12.903787 np0000000663 nova-compute[98103]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.50.100,3260] successful.
May 13 02:23:12.903787 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.911573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.911573 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.911573 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.911573 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.911573 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:12.911803 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.911803 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.911803 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.911803 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.911803 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:12.912130 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:12.912258 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to 192.168.40.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:23:12.912877 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] HCTL ('9', '-', '-', 0) found on session 227 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:23:12.912988 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:23:12.917588 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:12.929573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:23:12.929573 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:23:12.932626 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.932626 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.932626 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.932626 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.932626 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:12.932755 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.932755 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:12.932755 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.932755 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:12.932755 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:12.933049 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:12.933206 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to 192.168.50.100:3260 {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:657}}
May 13 02:23:12.933762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98103) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 13 02:23:12.933883 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98103) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 13 02:23:12.947417 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: None {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:23:13.275071 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:23:13.782143 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:23:13.782143 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.149s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:13.782627 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 53.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:23:13.947559 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98103) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 13 02:23:13.947735 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98103) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:685}}
May 13 02:23:14.810230 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found WWN 330000000b1e23d0a for multipath device dm-1 {{(pid=98103) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:813}}
May 13 02:23:14.810739 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:14.810798 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000b1e23d0a', 'path': '/dev/dm-1', 'multipath_id': '330000000b1e23d0a'} {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:23:14.810952 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b1e23d0a', 'path': '/dev/dm-1', 'multipath_id': '330000000b1e23d0a'} {{(pid=98103) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 13 02:23:14.813821 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:15.316467 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attempting to attach volume 40fa8b7a-1c4b-4790-bab6-852756f9c771 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98103) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 13 02:23:15.318104 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] attach device xml: <disk type="block" device="disk">
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:   <alias name="ua-40fa8b7a-1c4b-4790-bab6-852756f9c771"/>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:   <serial>40fa8b7a-1c4b-4790-bab6-852756f9c771</serial>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:15.318104 np0000000663 nova-compute[98103]:  {{(pid=98103) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 13 02:23:16.244412 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:16.244834 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:16.244834 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:23:16.244834 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:16.249953 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:16.250128 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:16.958084 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:16.958290 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:16.958290 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:16.958407 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No BDM found with device name hda, not building metadata. {{(pid=98103) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 13 02:23:16.958483 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] No VIF found with MAC fa:16:3e:d9:dc:2f, not building metadata {{(pid=98103) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 13 02:23:18.510832 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-c79c7b0a-24c0-492b-b558-9480dca657c8 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.408s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:18.952435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:18.952570 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:19.454881 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Detaching volume 40fa8b7a-1c4b-4790-bab6-852756f9c771
May 13 02:23:19.495158 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attempting to driver detach volume 40fa8b7a-1c4b-4790-bab6-852756f9c771 from mountpoint /dev/vdc
May 13 02:23:19.500348 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found disk vdc by alias ua-40fa8b7a-1c4b-4790-bab6-852756f9c771 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:23:19.501979 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found disk vdc by alias ua-40fa8b7a-1c4b-4790-bab6-852756f9c771 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:23:19.502137 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Attempting to detach device vdc from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:23:19.502395 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <alias name="ua-40fa8b7a-1c4b-4790-bab6-852756f9c771"/>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <serial>40fa8b7a-1c4b-4790-bab6-852756f9c771</serial>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:19.502395 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:23:19.509972 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully detached device vdc from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the persistent domain config.
May 13 02:23:19.510212 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] (1/8): Attempting to detach device vdc with device alias ua-40fa8b7a-1c4b-4790-bab6-852756f9c771 from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:23:19.510584 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <alias name="ua-40fa8b7a-1c4b-4790-bab6-852756f9c771"/>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-1"/>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <target dev="vdc" bus="virtio"/>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <serial>40fa8b7a-1c4b-4790-bab6-852756f9c771</serial>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:19.510584 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:23:19.982539 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778638999.9821208, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => ua-40fa8b7a-1c4b-4790-bab6-852756f9c771> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:23:19.983783 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-40fa8b7a-1c4b-4790-bab6-852756f9c771 for instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:23:19.986378 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully detached device vdc from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the live domain config.
May 13 02:23:19.987667 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:23:19.987980 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:23:19.988125 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:19.988459 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:19.988787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40fa8b7a-1c4b-4790-bab6-852756f9c771', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:23:19.988938 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:23:20.013910 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:20.013910 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:20.013910 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:20.013910 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:20.013910 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:20.014163 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:20.014163 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:20.014163 np0000000663 nova-compute[98103]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:20.014163 np0000000663 nova-compute[98103]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771 (non-flash)
May 13 02:23:20.014163 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:20.014273 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', '228')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:23:20.014273 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', '227')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:23:20.014961 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771', '228')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:23:20.015572 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c26aa20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'): ({'sde'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:23:20.015758 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Removing multipathed devices sde, sdd {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:23:20.015965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Flush multipath device 330000000b1e23d0a {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:23:20.047696 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:23:20.091787 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:23:20.138762 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:23:20.139024 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:23:20.139946 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:23:20.154287 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:23:20.154576 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:23:20.168727 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.199841 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.40.100,3260]
May 13 02:23:20.199841 np0000000663 nova-compute[98103]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.40.100,3260] successful.
May 13 02:23:20.199841 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.212394 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.221312 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.247777 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.50.100,3260]
May 13 02:23:20.247777 np0000000663 nova-compute[98103]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-40fa8b7a-1c4b-4790-bab6-852756f9c771, portal: 192.168.50.100,3260] successful.
May 13 02:23:20.247777 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.260707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:20.260890 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:20.260997 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== disconnect_volume: return (273ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:23:20.261123 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:23:20.808730 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:21.251517 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:21.252056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:21.252056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:23:21.252056 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:21.269076 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:21.269334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:21.814903 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-30c95d00-5119-4ca5-a7eb-8aa1bcc1f496 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.862s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:22.284731 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:22.285215 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:22.787368 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Detaching volume 58b6feae-2c40-4f57-9419-3ef8ff525542
May 13 02:23:22.822442 np0000000663 nova-compute[98103]: INFO nova.virt.block_device [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Attempting to driver detach volume 58b6feae-2c40-4f57-9419-3ef8ff525542 from mountpoint /dev/vdb
May 13 02:23:22.827180 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found disk vdb by alias ua-58b6feae-2c40-4f57-9419-3ef8ff525542 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:23:22.828748 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Found disk vdb by alias ua-58b6feae-2c40-4f57-9419-3ef8ff525542 {{(pid=98103) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 13 02:23:22.828915 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Attempting to detach device vdb from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the persistent domain config. {{(pid=98103) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 13 02:23:22.829222 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <alias name="ua-58b6feae-2c40-4f57-9419-3ef8ff525542"/>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <serial>58b6feae-2c40-4f57-9419-3ef8ff525542</serial>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:22.829222 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:23:22.835335 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully detached device vdb from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the persistent domain config.
May 13 02:23:22.835485 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] (1/8): Attempting to detach device vdb with device alias ua-58b6feae-2c40-4f57-9419-3ef8ff525542 from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the live domain config. {{(pid=98103) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 13 02:23:22.835766 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.guest [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] detach device xml: <disk type="block" device="disk">
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <alias name="ua-58b6feae-2c40-4f57-9419-3ef8ff525542"/>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <source dev="/dev/dm-0"/>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <target dev="vdb" bus="virtio"/>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <serial>58b6feae-2c40-4f57-9419-3ef8ff525542</serial>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]: </disk>
May 13 02:23:22.835766 np0000000663 nova-compute[98103]:  {{(pid=98103) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 13 02:23:23.291012 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Received event <DeviceRemovedEvent: 1778639003.2905629, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => ua-58b6feae-2c40-4f57-9419-3ef8ff525542> from libvirt while the driver is waiting for it; dispatched. {{(pid=98103) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 13 02:23:23.292588 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-58b6feae-2c40-4f57-9419-3ef8ff525542 for instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 13 02:23:23.294766 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully detached device vdb from instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 from the live domain config.
May 13 02:23:23.295804 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] calling os-brick to detach iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 13 02:23:23.296114 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x705c6c7e5a90>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 13 02:23:23.296324 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 13 02:23:23.296664 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 13 02:23:23.296952 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58b6feae-2c40-4f57-9419-3ef8ff525542', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:848}}
May 13 02:23:23.297054 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', 0)] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:859}}
May 13 02:23:23.320272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:23.320272 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:23.320272 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1248}}
May 13 02:23:23.320272 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:23.320272 np0000000663 nova-compute[98103]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542 (non-flash)
May 13 02:23:23.320272 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1237}}
May 13 02:23:23.320679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '226')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:867}}
May 13 02:23:23.320679 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '225')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:23:23.321184 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542', '226')] {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:880}}
May 13 02:23:23.321746 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x705c6c7da8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'): ({'sdc'}, set())}) {{(pid=98103) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:913}}
May 13 02:23:23.321906 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Removing multipathed devices sdb, sdc {{(pid=98103) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 13 02:23:23.322103 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Flush multipath device 3300000006d4fcb67 {{(pid=98103) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 13 02:23:23.353675 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:23:23.393785 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98103) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 13 02:23:23.428525 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 13 02:23:23.428707 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98103) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 13 02:23:23.429245 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 13 02:23:23.440968 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.linuxscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98103) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 13 02:23:23.441158 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542')] {{(pid=98103) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1226}}
May 13 02:23:23.451821 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.476233 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.40.100,3260]
May 13 02:23:23.476233 np0000000663 nova-compute[98103]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.40.100,3260] successful.
May 13 02:23:23.476233 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.487445 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.498071 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.528020 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.50.100,3260]
May 13 02:23:23.528020 np0000000663 nova-compute[98103]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-58b6feae-2c40-4f57-9419-3ef8ff525542, portal: 192.168.50.100,3260] successful.
May 13 02:23:23.528020 np0000000663 nova-compute[98103]:  stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.538778 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98103) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1092}}
May 13 02:23:23.538965 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.base [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.242s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 13 02:23:23.539075 np0000000663 nova-compute[98103]: DEBUG os_brick.initiator.connectors.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] <== disconnect_volume: return (242ms) None {{(pid=98103) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 13 02:23:23.539234 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Disconnected iSCSI Volume {{(pid=98103) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 13 02:23:24.078144 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'flavor' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:25.083276 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-42a843a3-08d1-4daf-bf0b-c97e9297f7df tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.798s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:25.525436 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:25.525609 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:25.525744 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:25.525857 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:25.525956 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:25.527750 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Terminating instance
May 13 02:23:26.030285 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Start destroying the instance on the hypervisor. {{(pid=98103) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 13 02:23:26.043334 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.045148 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.059011 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.063710 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.074728 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.079380 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.174365 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:23:26.175700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:26.175700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:26.175700 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:26.175700 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] No waiting events found dispatching network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:23:26.175700 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-7fceceb4-9c36-4e15-9c8e-243144a4da2c req-ac455305-9c18-47e4-aa44-6ffe6147a989 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:23:26.269112 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.317639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.323456 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.346395 np0000000663 nova-compute[98103]: DEBUG nova.utils [None req-03fa68e6-f097-415d-9767-a4eceb93a441 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999629510999966 future=<Future at 0x705c6c7110d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:26.346751 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999225460999696 future=<Future at 0x705c6c7110d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:26.346842 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=14.999121355999705 future=<Future at 0x705c6c7110d0 state=pending>) {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:26.348423 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Instance destroyed successfully.
May 13 02:23:26.348873 np0000000663 nova-compute[98103]: DEBUG nova.objects.instance [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lazy-loading 'resources' on Instance uuid 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 {{(pid=98103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 13 02:23:26.851118 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.vif [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-13T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1926004108',display_name='tempest-TestServerVolumeAttachmentScenario-server-1926004108',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000000663',hostname='tempest-testservervolumeattachmentscenario-server-1926004108',id=81,image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEIf1YM/0K80ledoHvQy3WQ2tjNyQUH2CX9EcsAwmmHJb0b/2pzmlHYWxYlKE7UYvS+GhgDZ8ifa9u/58We7Tu7V7zS/AE4MZ/UUoa9ppNXRJ5Hl8OutWoHoQkPyIMiag==',key_name='tempest-keypair-423622502',keypairs=<?>,launch_index=0,launched_at=2026-05-13T02:22:18Z,launched_on='np0000000663',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000000663',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e40c18799984d74acc2fdcf1bd54262',ramdisk_id='',reservation_id='r-hn07899z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ce64da57-4ea7-4983-8f5e-9324f00e60fa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-401205016',owner_user_name='tempest-TestServerVolumeAttachmentScenario-401205016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-13T02:22:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3758e5bd761e4e6e8e4b6322109b2a08',uuid=9f6e3e9f-e010-4719-a59c-7cf8d87d6df6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:881}}
May 13 02:23:26.851407 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converting VIF {"id": "20df7c35-4692-43c9-acb5-aa430b9287c6", "address": "fa:16:3e:d9:dc:2f", "network": {"id": "3622da29-bde0-4510-9ffc-949916d2e828", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-591958-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5e40c18799984d74acc2fdcf1bd54262", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20df7c35-46", "ovs_interfaceid": "20df7c35-4692-43c9-acb5-aa430b9287c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:523}}
May 13 02:23:26.851920 np0000000663 nova-compute[98103]: DEBUG nova.network.os_vif_util [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46') {{(pid=98103) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:560}}
May 13 02:23:26.852143 np0000000663 nova-compute[98103]: DEBUG os_vif [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46') {{(pid=98103) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:109}}
May 13 02:23:26.853798 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.853798 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20df7c35-46, bridge=br-int, if_exists=True) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:23:26.854612 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.855350 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:26.855514 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.856100 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 15 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.856246 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b15d71e2-3d95-4435-ac33-38204b71e07b) {{(pid=98103) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 13 02:23:26.856654 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.857051 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:26.857210 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:26.858701 np0000000663 nova-compute[98103]: INFO os_vif [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:dc:2f,bridge_name='br-int',has_traffic_filtering=True,id=20df7c35-4692-43c9-acb5-aa430b9287c6,network=Network(3622da29-bde0-4510-9ffc-949916d2e828),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20df7c35-46')
May 13 02:23:26.858959 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Deleting instance files /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6_del
May 13 02:23:26.859658 np0000000663 nova-compute[98103]: INFO nova.virt.libvirt.driver [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Deletion of /opt/stack/data/nova/instances/9f6e3e9f-e010-4719-a59c-7cf8d87d6df6_del complete
May 13 02:23:27.365330 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Took 1.33 seconds to destroy the instance on the hypervisor.
May 13 02:23:27.367218 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._common.loopingcall [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98103) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 13 02:23:27.367449 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Deallocating network for instance {{(pid=98103) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 13 02:23:27.367598 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] deallocate_for_instance() {{(pid=98103) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 13 02:23:27.367854 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:23:27.457409 np0000000663 nova-compute[98103]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 13 02:23:27.754846 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:27.926297 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-433ea479-763a-4b94-9573-57450d498a1e req-00835dd2-9450-472a-9c7b-7cbad6897eef service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-deleted-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:23:27.926297 np0000000663 nova-compute[98103]: INFO nova.compute.manager [req-433ea479-763a-4b94-9573-57450d498a1e req-00835dd2-9450-472a-9c7b-7cbad6897eef service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Neutron deleted interface 20df7c35-4692-43c9-acb5-aa430b9287c6; detaching it from the instance and deleting it from the info cache
May 13 02:23:27.926689 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [req-433ea479-763a-4b94-9573-57450d498a1e req-00835dd2-9450-472a-9c7b-7cbad6897eef service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:23:28.229894 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 13 02:23:28.230290 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] Acquiring lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:28.230465 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:28.230608 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:28.230737 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] No waiting events found dispatching network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 {{(pid=98103) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 13 02:23:28.230871 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-f07d56a4-d6d1-43b0-bb25-fb4c8de9da44 req-5bf054bb-ae7c-4a0b-9203-e31ad1879222 service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Received event network-vif-unplugged-20df7c35-4692-43c9-acb5-aa430b9287c6 for instance with task_state deleting. {{(pid=98103) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 13 02:23:28.297703 np0000000663 nova-compute[98103]: DEBUG nova.network.neutron [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Updating instance_info_cache with network_info: [] {{(pid=98103) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:104}}
May 13 02:23:28.429825 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [req-433ea479-763a-4b94-9573-57450d498a1e req-00835dd2-9450-472a-9c7b-7cbad6897eef service nova] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Detach interface failed, port_id=20df7c35-4692-43c9-acb5-aa430b9287c6, reason: Instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 could not be found. {{(pid=98103) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 13 02:23:28.799521 np0000000663 nova-compute[98103]: INFO nova.compute.manager [-] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Took 1.43 seconds to deallocate network for instance.
May 13 02:23:29.305295 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:23:29.305435 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:23:29.384054 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:23:29.384239 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:23:29.886452 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:23:30.392008 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.086s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:30.434208 np0000000663 nova-compute[98103]: INFO nova.scheduler.client.report [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Deleted allocations for instance 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6
May 13 02:23:31.442780 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3608e7c8-76e3-46b3-80ab-8a602109ed32 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Lock "9f6e3e9f-e010-4719-a59c-7cf8d87d6df6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.917s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:23:31.857928 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:35.557956 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:36.871054 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:36.960777 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:41.346471 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x705c89f3fa10>>, remaining_delay=-0.00037053100004413864 future=<Future at 0x705c6c7110d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x705c8c06a030> {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:41.346471 np0000000663 nova-compute[98103]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98103) _log /opt/stack/nova/nova/utils.py:1500}}
May 13 02:23:41.346997 np0000000663 nova-compute[98103]: DEBUG nova.virt.driver [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] Emitting event <LifecycleEvent: 1778639006.3459044, 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6 => Stopped> {{(pid=98103) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 13 02:23:41.346997 np0000000663 nova-compute[98103]: INFO nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] VM Stopped (Lifecycle Event)
May 13 02:23:41.849500 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-e614c222-e28d-4faf-8108-b41431bb1f56 tempest-TestServerVolumeAttachmentScenario-401205016 tempest-TestServerVolumeAttachmentScenario-401205016-project-member] [instance: 9f6e3e9f-e010-4719-a59c-7cf8d87d6df6] Checking state {{(pid=98103) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 13 02:23:41.872545 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:46.873071 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:46.873553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:46.873553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:23:46.873553 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:46.873779 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:46.873940 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:51.874734 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:56.879639 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:56.880184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:23:56.880184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:23:56.880184 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:23:56.883868 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:23:56.884039 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:01.889652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:01.889652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:01.889652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:24:01.889652 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:01.895880 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:01.896143 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:06.896433 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:06.896977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:06.896977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5000 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:24:06.896977 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:06.903159 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:06.903287 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:07.776527 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:07.776726 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:07.776910 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:07.777153 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:07.883950 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:07.884217 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:08.883788 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:08.884228 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:08.884228 np0000000663 nova-compute[98103]: DEBUG nova.compute.manager [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98103) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 13 02:24:08.884384 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:09.883880 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:09.884315 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:10.177254 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:10.388038 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:24:10.388221 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:24:10.388302 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:24:10.388472 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Auditing locally available compute resources for np0000000663 (node: np0000000663) {{(pid=98103) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 13 02:24:10.404227 np0000000663 nova-compute[98103]: WARNING nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 13 02:24:10.404879 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 13 02:24:10.450495 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.processutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98103) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 13 02:24:10.450744 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Hypervisor/Node resource view: name=np0000000663 free_ram=14475MB free_disk=72.62029266357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}] {{(pid=98103) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 13 02:24:10.450858 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
May 13 02:24:10.451105 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
May 13 02:24:11.496575 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 13 02:24:11.496948 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Final resource view: name=np0000000663 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:24:10 up 48 min,  1 user,  load average: 1.13, 3.96, 4.61\n'} {{(pid=98103) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 13 02:24:11.536319 np0000000663 nova-compute[98103]: DEBUG nova.virt.libvirt.driver [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98103) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 13 02:24:11.536319 np0000000663 nova-compute[98103]: DEBUG nova.compute.provider_tree [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed in ProviderTree for provider: 97b2898b-d3c3-45e4-a1d2-ef71603b8684 {{(pid=98103) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 13 02:24:11.908146 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:11.908343 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:11.908409 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:24:11.908491 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:11.929883 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:11.930059 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:12.038017 np0000000663 nova-compute[98103]: DEBUG nova.scheduler.client.report [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Inventory has not changed for provider 97b2898b-d3c3-45e4-a1d2-ef71603b8684 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98103) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 13 02:24:12.543587 np0000000663 nova-compute[98103]: DEBUG nova.compute.resource_tracker [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Compute_service record updated for np0000000663:np0000000663 {{(pid=98103) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 13 02:24:12.544021 np0000000663 nova-compute[98103]: DEBUG oslo_concurrency.lockutils [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.093s {{(pid=98103) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
May 13 02:24:12.544021 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:13.538353 np0000000663 nova-compute[98103]: DEBUG oslo_service.periodic_task [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98103) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}}
May 13 02:24:13.538739 np0000000663 nova-compute[98103]: DEBUG oslo.service.backend._threading.loopingcall [None req-3d7a6783-8d01-4cbc-99c9-4106fc904a2f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.34 seconds {{(pid=98103) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 13 02:24:16.930596 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:21.946774 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:21.947264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:21.947264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5016 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:24:21.947264 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:21.947379 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:21.947407 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:26.953335 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:26.953335 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 13 02:24:26.953335 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98103) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 13 02:24:26.953335 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:26.965089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:26.965089 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98103) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 13 02:24:31.966271 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:36.968479 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:41.969810 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:46.970993 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 13 02:24:51.973382 np0000000663 nova-compute[98103]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98103) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}